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ABSTRACT 

This document describes two evaluations of the Upward 
Bound program under the Office of Economic Opportunity. The first 
evaluation was a descriptive-analytical study of the impact of Upward 
Bound on the community and the high school. This study was carried 
out through extensive field work, including interviews and 
observations in high schools, on campuses of institutions of higher 
learning, and in the community. It was a nationwide study conducted 
in 16 communities. During the course of the study, 447 persons were 
interviewed, including secondary school personnel (teachers), 
librarians and principals, university personnel (faculty. Upward 
Bound coordinators and administrators) , students (both participants 
and non-participants in Upward Bound) , and community leaders 
(Community Action staff and board members, public officials and 
school board members) . The second evaluation had three major 
purposes: (1) to synthesize all of the previous evaluations of Upward 
Bound; (2) to gather additional firsthand information on the impact 
of Upward Bound; and (3) to carry out a cost/benefit analysis of the 
program. This document deals primarily with the third aspect of the 
second evaluation, although there is detail on the first evaluation 
and the other two objectives of the second evaluation as well. 
(Author/JM) 
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E\^ALUATIOriS OF UPWARD BOUIID FOR THE 
OFFICE OF ECONOMIC OPPORTUIJITY 



Hazel S. McCalley^ 
Greenleigh Associates 



Greenleigh Associates^ Inc.^ is a private iTianagement con-- 
suiting and research firm founded in 1956. Originally^ it v/as 
founded to provide management consulting services to voluntary- 
organizations. Hov/ever^ since 19^0^ the major emphasis has 
been on evaluation studies and research efforts in fields rela- 
ting to the conservation of human resources. Studies have been 
conducted in the fields of public welfare^ medi^jal assistance^ 
child v/elfare, mannovrer* education, housing;, vocational rehabi-- 
litation^ mental healthy health and drug prof;rams^ alcoholism^ 
and related fields. 

Greenleigh Associates employs more tnan 60 social scientists 
from the fields of social research^ urban planning^ sociology^ 
psychology^ economics^ political scienje^ education^ social v:el-" 
fare^ and public administration. In addition to the full-time 
sta^"^ consultants are employed frorx a variety of fieldc to 
pr ,de special content inputs. Clients include a wide variety 



\)r. McCalley is Senior Vice President of Greenleigh Asso- 
ciates and has been v/ith the firm for about 15 years. She was 
officer in charge of the tv:o Upv;ard Bound evaluations and v;as 
ultimately responsible for the approval of all instruments and 
methods used. Dr. McCalley holds a Ph.D. from the University 
of Pennsylvania in econoii'ics and has directed or been the of- 
ficer in charge of more chan 75 studies conducted by Greenleigh 
Associates. Recently completed and almost completed studies 
include a model for a longitudinal study of drug treatment moda- 
lities^ numerous evaluations of Title I ESEA programs and other 
educational programs for the disadvantaged^ a study of the bar- 
riers to separation of income maintenance and social services 
in public v/elfare^ and the development of a model for employer 
services in the public employment service. 
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of federal, state, and local agencies, as well as private orga- 
nizations. At the present time, a model for measuring social 
accountability in the private sector is being developed. 

INTRODUCTION 

The chapter describes tv;o evaluations of the Upv;ard Bound 
program under the Office of Economic Opportunity, This program 
was designed for underachievers from lov; income families in 
secondary schools to provide them v;ith the necessary motivation 
and skills to achieve success in college. It was intended to 
link an institution of higher learning, the host institution, 
with secondary institutions to provide an enriched educational 
experience to the target group on the college campus in the 
summer and in the high school during the normal school year. 

The first evaluation v;as a descriptive-analytical study of 
the impact of Upward Bound on the community and the high school. 
This study was carried out through extensive field work, includ- 
ing interviews and observations in high schools, on campuses 
of institutions of higher learning, and in the community. It 
v/as a nationwide study conducted in l6 communities. Since there 
were some 300 Upward Bound programs, the l6 communities could 
not be considered a statistically valid sample representing the 
variables to be found in such programs. 

During the course of the study, persons were interviewed, 

including secondary school personnel (teachers, librarians and 
principals), university personnel (faculty. Upward Bound coor- 
dinators, and administrators), students (both participants and 
nonparticipants in Upward Bound), and community leaders (Community 
Action staff and board members, public officials and school board 
members ) , 

The second evaluation had three major purposes: 

1) to synthesize all of the previous evaluations of 
Upward Bound; 

2) to gather additional firstnand information on the 
impact of Upward Bound; and 

3) to carry out a cost/benefit analysis of the program. 

This chapter deals primarily with the third aspect of 
the second evaluation, although there is detail on the first 
evaluation and the other two objectives of the second evalua- 
tion as well. 
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PART I: THE STUDY EIP/IROIII^NT 



BACKGROU!hD 0 ? UPVrARD BOUIiD 

Upv/ard Bound is a pre -college preparatory program designed 
to generate che skills and motivation necessary for success in 
education beyond high school among yo^jng people fron lov; -income 
backgroords and inadequate secondary school preparation. ^ It 
acts to remedy poor academic pre^paration and motivation in the 
secondary school and thus increase a youngster's promise for 
acceptance and success in a college environment. 

Projects must inc3-ude arrangements to assure cooperation 
among one or more institutions of higher education and one or 
more secondary schools. They must include a curriculiin designed 
to develop creative thinking, effective expression, and attitudes 
tov/ard learning needed for post-secondary educational success; 
necessary health services; and such recreational and cultural 
and group activities as the project director determines may be 
appropriate . 

Tw.T^T,^ Povr.'^ . -^unded by the Office of Economic Opportunity 
(OEO)/grew out of a pilot project in the summer of I9S5 pro- 
posed by Dr. Thomas Billings of Washington State College. This 
pilot project v/as in response to a number of uncoordinated re- 
quests to the federal government and foundations to establish a 
college-siDonsored urogram v/hich would give disadvantaged stu- 
dents the' capability to attend college and succeed. The pilot 
project was undertaken in I6 institutions of higher education 
in v;hich slightly over 2,000 students participated. Of those 
participating, roughly 1,500 had just completed high school. 
The summer pilot project was followed by a I965-I966 academic 
follow-up pilot project involving 1,200 students. 

As a result of these pilots, it v;as concluded that a single 
summer was insufficient to prepare disadvantaged high school 
graduates for college. Therefrom, the Upward Bound program was 
designed to take students in ninth grade and older on a ycctr- 
round program, September through June, coordinated with the on- 
going high school program and an on-campus college program. 
Guidelines for the I955-I966 program v;ere developed and funded 
by OEO as a national program in I966. 



The level of funding in 1965-1970 and the nxmber of parti- 
cipant students and institutions was as follov/s: 



Table 1 



upward Bound Budget, Programs, and Students, 1965-1970 



Summer 

1965 
1966 

1967 
1968 

1969 ^/ 

1970 2/ 



Nxjmber of 

Programs 

Operating 



17 
218 
249 
285 
296 
295 



a/ 



Number of 

Students 

Enrolled 

2,061 

20,333 
22,4^10 

25,368 

23,220 

22.000+2:/ 



Federal Dollars 
Expended 
(millions ) 

2.4 
24.9 

31.6 b/ 

30.9 , / 

28.3 ^/ 



Estimate . 

^/ Beginning with I968 programs, the federal share of all 
OEO grants was decreased from 90 to 80 percent, and the 
local share increased to 20 percent. 



Twelve program attributes are considered essential. These 
were specified in the 1969-1970 Guidelines as: 



1. 

2. 
3. 

4. 

5. 
6. 



Development of significant working relationships among 
secondary schools, colleges and universities, and the 
community at large. 

Involvement of teachers who are committed to the goals 
of Upward Bound. 

Provision for close and substantial individual student- 
teacher contact both in the summer and the academic 
year. 

Effective use of college and imiversity students as 
tutor-counselors, both in the slimmer and in the 
academic year. 

Involvement of many resource and non -professional 
persons from the local communities. 

Willingness on the part of all of the staff to engage 
the students as partners in learning. 
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7. An important emphasis on educational goals other 
than the strictly academic^ including activities 
designed to develop abilities to organize^ to 
persuade^ and to cooperate. 

8. Recognition by the sponsoring institution of this 
unusual chance to increase its skills in teaching 
students of v/hatever kind. 

9. Enrollment of a student body v;hich is diverse v/ith 
regard to background and race^ including the taking 
of affirmative steps to ensure recruitment of stu- 
dents from racial or ethnic backgrounds that have 
not been v;ell represented at the sponsoring 
institution. 

10. The presence of a project director^ or his assistant^ 
working v:ith the program on a full-time basis through- 
out the year. 

11. Recognition that the academic year is at least as 
important as the summer. 

12. Enrollment of a sizeable cluster of students from 
a fev; secondary schools, rather than an enrollment 
of a handful of students from a large number of 
schools . 

It is essential to understand the purposes and attributes 
in order to comprehend the problems involved in evaluation of 
the program and the results. 

One of the motivating factors in the initiation of these 
programs during the sum.mers of 1964 and 1965 was undoubtedly the 
relationship betv/een college students and faculty and the civil 
rights movement which had dravni many ^university people to the 
South in the summers of the early 1960^ s. Students and faculty 
mostly v;hite^ returned to their educational institutions^ mostly 
in the North., nev/ly av;are of the lack of poor and minority 
representation on the college campus. They urged their institu-- 
tions to examine themselves to determine hov; they could offer 
their expertise to these underprivileged groups. 

Many of the proposals for action by students., faculty^ or 
administrators suggested programs patterned after the summer 
institutes sponsored on college campuses for high school upper- 
classmen by agencies such as the National Science Foundation. 
The programs either bore names that were part of the history of 
the time such as Project Overcome or the College Candidate 



Program^ or else bore a series of initials that bespoke purpose 
such as HEP^ SOS^ or ABC. In general^ they all aimed to pro- 
vide special college-like classes and to introduce these special 
students to the environment of higher education. 



B. PRIOR g7/ALUATI0::S 

Tv^o evaluations of Upv/ard Bound v;ere undertaken by Green- 
leigh Associates^ the second gro>;ing out of the first. 

Prior to the evaluations by Greenleigh Associates^ some 11 
other evaluations of Upv/ard Bound had been completed. These 
evaluations focused on a number of topics: attitudinal change 
of participants; grade point averages^and test scores., retention 
in high school^ social characteristics of Upv;ard Bound students^ 
college admissions^ college retention or persistence^ college 
problems of participants^ financial needs of Upv/ard Bound par- 
ticipants^ impact of Upv/ard Bound on secondary schools^ impact 
on host institutions (higher education)^ and parental involve-- 
ment. The evaluations are listed belov/. 



List of Prior Research Studies of Upward Bound 
Author and/or Agency Studies 



David E, Hunt and Robert H. 
Hardtjj Syracuse Youth 
Development Center 



Paul Daniel Shea 

Primary Prevention Research 

and Development Center 

John Gardenhire 

Data Systems Office of 

Educational Assoc. ^ Inc. 



Characterization of Upv/ard Bound 
Studies: Summer 19tb; Academic 
Year 1906*- 19^7 ; Academic Year 
19b7-19oc^ " 

National and Regional Profile of 
I9&7 Upv:arQ Bound students ; 
National Profile of 19o7 "Jpvrard 
Bound Students: i:ational Profile 
of 19^7 Upv^ard Bound Programs ; 
National andTl^egional Profile of 
1907 Upv:ard Bound Programs . 

Upv/ard Bound, Early Progress 
Problem.s and Promise in Educational 
Escape from Poverty , July 19bb, 

Study of College Retention of I965 
and 1900 Upv/ard Bound Bz^idge 
Students , I900 . 
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Author and/or Agency 



Studies 



Bonnie R. Cohen and 

Ann H. Yonkers 

Research Management Corp, 

The Comptroller General of 
the United States^ U.S. 
General Account: ng Office 

H. Reed Saian.der'^ and 
Stephen S. .7oneo 
Financial Aid Services of 
American College Testing 
Program (AC "3) 

Cybem Educe on^ Inc. 



Sar A. Levitari 

Center for Me::-^pov;er Policy 

Studies: Geor^,e Washing-con 

University 

.TQ3or>v» Proo^^'^^r . Office of 
Program Planning and Evalu- 
ation^ Office of Education^ 
U.S. Department of Healthy 
Education and V/elfare 

Francis A. Komegay^ Jr. 
Data System Office of 
Educational Assoc. ^ Inc. 



Evaluations of the War on Poverty ^ 
Education Programs^ March 19bS . 



Report to Congress; Reviev; of 
Economic Otpportunity Programs ^ 
I4arch 1969. 

A Study of Financial Need of 
Upv/ard Boujid Students: The 
195a-19b9 Bridge Class, ±968. 



Parental Involvement in Upv/ard 
Bound 3 June 19o9. 

Upv/ard Bound: Fighting Poverty 
With a Sheepskin, 19ocj. 



Stiidents ^nd Building s : An 
Anal'y'si's" of Selected "Federal 
Pro grams for Higher Education , 
May 19^6. 



College Enrollment of Former 
Upv/ard Bound Students: A Profile 
and Sumjnary 



These evaluations studies in the larger sense specify v/hat 
the major policy issues v/ere relative to Upv;ard Bound: 

1. Did Upward Bound affect the high school and college 
dropout rates among the disadvantaged? 

2. Were Upv;ard Bound participants from the target 
population^ i.e.-, the disadvantaged^ underachievers? 

3. Did participants demonstrate a ch'vnge in cognitive 
and affective skills? 
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V/hat v;as the impact of llpv;ard Bound on secondary 
education and institutions of higher education? 



5. ^/hat v/ere the problems of Upv/ard Bound participants 
v/hich v/ere inherent in the program? 

These questions v;ere a part of the larger question of that 
period v;hich v:as: v;hat could or should be done to provide the 
disadvantaged v;ith the same conditions as che advantaged popu- 
lation^ and hov;? The research v;as designed to ansv/er these 
questions , 

Another issue v/as v/hether an educational program should be 
funded by OEO. All traditional agencies^ the U.S. Employment 
Service^ the Welfare Administration and the Office of Education 
(OE) in particular had been threatened by the advent of OEO. 
The old line agencies sav; their prerogatives being usurped and 
each attempted to secure support in Congress for retaining its 
traditional role and responsibility. Head Start^ Adult Basic 
Education and Upv:ard Bound^ all initiated by OEO^ were subsequently 
transferred to OE after a bitter struggle. 

One of the bitterest opponents of Upward Bound v;as Repre- 
sentative Edith Green of Oregon. It v/as reported by Dr. Frost-, 
an early director of Upv/ard Bounds that Mrs. Green felt she 
already had a high school studeni: program for v/hich she had 
been responsible ^ the Talent Search Program^ v/hich was in opera- 
tion at the OE. 

Mrs. Green argued that either Upv:ard Bound v/as rev/arding 
dropouts or that it represented double administration since it 
was so much like Talent Search. In either event^ she felt that 
the recruitment focus v/as "contrary'^ to the original intent of 
the legislation.^ Congressv/om.an Green v/as determined to see the 
program killed or at least taken av/ay from the jurisdiction of 
OEO. The tv/o evaluations undertaken by Greenleigh Associates 
were intended to counter some of Mrs. Greenes objections. 

The first evaluation was awarded to Greenleigh Associates 
on a sole source basis by the Office of Economic Opportunity 
(OEO) and v/as a study of the impact of Upward Bound on secondary 
schools and the community. It v/as planned as one of a number of 
impact studies v/hich v/ould point out the effect of the program 
on the students^ the students^ families^ the university^ the 
community^ and the secondary school. It was hoped that these 
studies v/ould answer some of the then current criticism of the 
program. 



Congressional Record , House, July 24^ 1968^ pp. H7407-7''-th^ 
and the Record, House, July 25, 1968, pp. H7^9^^~7^99. 



At the time the contract v;as awarded and the study xmder- 
taken, there v;ere rumblings in Congress, some suspected inspired 
by the Office of Education (OF), that Upv/ard Bound v;as not 
attaining its goals... that it v;as not effective in reaching the 
target population or in helping underachieve rs from the poverty 
population move into the academic v/orld. As one of the number 
of "poverty" programs v.-hich had been started by the Office of 
Economic Opportunity v;ith great hope and optimism, it began to 
suffer from* the fact that it v.'as not able to cure poverty. In 
addition, there had developed a general malaise in regard to 
poverty programs in general and Upv;ard Bound in particular. Also, 
Upv.'ard Bound struck directly at an entrenched establishment -- 
public education -- and as such, created enemies. 

The fact that educational funds v;ere given to OEO, bypas- 
sing OE, v;as resented by the educational establishment. This 
intensified the feeling that the Upv;ard Bound program not only 
provided a link to secondary schools through the program, but 
that the program in effect v/as saying that the schools needed 
such supriort, and that it also provided summer programs because 
the schools could not adequately solve the educational problem 
of the target population. Even given the problems of furiding, 
ghetto conditions which create learning problems, and other 
external factors affecting this population, Upv/ard Bound v.'as 
Derceived as a threat to public education methods. As such, it 
was attacked by the eaucational community. The only completely 
negative evaluation v/as done by a member of the research staff 
of the OE. 

In addition, Upv/ard Bound had an unusual administrative 
stiTicture v/hich partially invited attack. Although administered 
by the Office of Economic Opportunity, much of its day-to-day 
operations were under the supervision of an independent contrac- 
tor. Education Associates, Inc. (EAI). This firm had been brought 
into existence to provide ou'sside consultation to Upv.-ard Bound. 
This consultation grew to the point where EAI v;as essentially 
managing the program. It v;as alleged that the Director of Upvrard 
Bound was fostering a profit-making operation for friends. Those 
in the program countered by claiming that by using a private 
contractor it was possible to start a program more expeditiously 
since a private firm v;as not subject to governmental restraints 
which hamper civil servants. In their view, the ends justified 
the means. This is an interesting and unresolved question. 

The idea for a second evaluation grew out of the first. 
The Director felt that the report from the first Greenleigh 
study v;as the first evaluation which could be used to inter- 
pret the program to Congress and the public. (The report 
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had been v;ritten in non-academic, non- technical language v;hich 
the average citizen could understand.) The director v/anted a 
broader history and a broader evaluation of the program under- 
taken and written in similar ttyle and language. The second 
evaluation was managed out of CEO's central evaluation office, 
hov/ever, and not the Upward Bound program office. 

As is often the case, there was a time lag of several 
months between the time the second evaluation v/as planned and 
when it v;as funded. During that interim the Congress voted to 
transfer the program from OSO to OE. ■J-.Tiile the actual transfer 
had not yet taken place at the time the evaluation was started, 
the project was of necessity done during v;hat must be described 
as a transition period. Thus, although the contract was with 
OEO, the study staff worked closely with both OEO and OE during 
the final months of evaluation. 



PROCUKEMErIT OF THE STUDIES 

The origins of these two evaluations v/ere different. The 
first study v;as the result of a number of conversations with 
the program director on the kinds of evaluations needed to 
determine the extent to v;hich Upward Bound was meeting its 
goals. As a result, a series of proposals were piepared by 
Greenleigh Associates on various aspects of the problem; one of 
the series was funded. 

The other proposals which were prepared and were not funded 
related to the impact of Upward Bound on the participants, the 
impact on the parents, and the impact on the host institution. 
In retrospect, the proposal which v/as funded was that which 
would show the least impact. This v/as a study of the impact on 
the community and the secondary schools. Later analysis re- 
vealed considerable impact on participants and the parents and 
some impact on the host institutions. However, th3 number of 
Upward Bound students in a given community and in the average 
high school was too small to affect the traditional teaching 
methods . 

The second study came about as the result of a Request for 
Proposal from OEO and was awarded on a competitive basis. How- 
ever, since the successful bidder had already done a study which 
met the needs of the director, bidding cannot be considered to 
have been completely competitive in the sense that all bidders 
started from the same vantage point. This inequity, however, 
is frequently present in the procurement process. A successful 
bidder on a Request for Proposal has often done a similar study 
for the government and for the persons requesting the proposal. 




The Request for Proposal (RFP) came from OEO and stated 
the follov;ing objectives: 

1. Synthesis of the information nov; available on the 
program as it has been conceived and operated 
within 0E0<, including (but not limited to) the 
f ollov;ing points : 

a. Degree to which Upv;ard Bound has focused in 
concept and operation on important needs of 
the youth tov;ard whom it is aimed. 

b. Extent of reaching the intended population, 

c. Characteristics of students and staff, 

d. Varieties of program pursued by the grantees. 

e. Number of enrollees involved in projects^ by 
fiscal year, 

f . Impact on students^ their families-, and their 
communities, 

g. Pro.iect^ high schc^l-, and college retention 
rates, 

h. Changes in academic performance at secondary 
and post-secondary levels. 

1, Rates at v/hich entrance to post-secondary 
institutions has been sought and obtained, 

j. Nature and adequacy of financial support 

obtained during the freshman and subsequent 
years, . 

k. Impact on secondary and post-secondary insti- 
tutions . 

2, Assessment of the degree of success v/ith which national 
program objectives (as outlined in the Upv;ard Bound 
Guidelines) have been achieved to date and factors 
contributing to success. 

3, A benefit-cost analysis of the actual and estimated 
economic consequences of program participation^ to 
the extent possible with the existing data. The 
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contractor v;ill be expected to comment on the kinds 
of data and other factors which should be included 
in a more comprehensive benef it--cost analysis^ and 
the scope of work required for this. 

4. Evidence indicates that parti*^' ' ' ^n in Upward Bound 
has generally not produced s ?^ .nt improvements 
in high school academic achitiVc^.^snt^ yet Upward Bound 
graduates have entered and stayed in college at rates 
equal to or above the national average. In light of 
this fact^ the contractor should offer ansv;ers to the 
follov/ing questions: 

a. \lhBit has Upward Bound done to engender this 
kind of performance? 

b. Why has Upward Bound "v;ork8d"? 

5* Comments on what constitutes the Upward Boujnd contri- 
bution in terms of innovative approaches to compen- 
satory education. 

6. Recommendations about the way in v;hich future evalua- 
tions of Upv;ard Bound should be designed. (Comments 
may be included on evaluation at the individual pro- 
ject^ as v;ell as at the national level.) 

7. The contractor shall also make recommendations about 
desirable changes in the nature and administration of 
the program itself. 

After introductory statements demonstrating a knov;ledge of 
the subject and a restatement of objectives^ the proposal v/hich 
resulted from this PJ^P discussed the precise tasks v;hich could 
be undertaken^ the methods to be used and the instruments to be 
developed. Under each of eight tasks which v/ere specified in 
the proposal^ there was a statement of the research considera- 
tions implied in the task^ for example^ specifying the dependent 
and independent variables^ the measures v:hich would be used^ the 
types of instruments to be developed^ and the nature of the 
analysis . 

The remainder of the proposal dealt with task phasing and 
timing^ staffing^ including curricula vitae of staff^ and the 
capability of the firm. A budget was drawn up in a separate 
financial proposal; this is common practice for federal projects. 
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The issues that emerged in v;riting the proposal are alv/a^rs 
a consideration -- to be clear about v;hat v;ill be done and at 
the same time not promise too much, and to be realistic about 
the man-days and skills required. The persons responsible for 
the proposal v;ere fully aware of the implications of the task, 
particularly those related to past research and the data base. 
The data were knovm to be extensive but the extent to -which 
they v.'ere compatible v.-as unkno'.-m. For exam.ple, one task was a 
cost-benefit study. It was knovm that there were ample data 
on participants over time, but it v;as not known if there would 
be data on a control group which is necessary for this kind of 
a cost-benefit study. The statement of v;hat would be done had 
to be couched in language which would make it possible, within 
the contractual arrangement, to discard a task if it was not 
feasible . 



PERFORMING TK5 STUDIES 



1. Execution of the Tv;o Studies 

The execution of the two studies followed a similar pat- 
tern. Each was under the direct supervision of a project direc- 
tor who was given responsibility for day-to-day conduct of the 
study, incluoiiife obudy dc:oig,ii, sej.uCt.j.on of stafi ne'^ded to 
carry out field work, and the analysis of data. The project 
director v/as under the general supervision of an officer-in- 
charge who was responsible for seeing that the proposed study 
design was being carried out, time commitments kept, and that 
the unanticipated needs of the study group were met. The study 
group operated on a team concept. 

Those responsible for study design and data analysis worked 
together in developing study instruments and in analyzing the 
data results. This does not mean that a group worked together 
producing instruments or analysis. Rather, the study group dis- 
cussed what instruments would be required, what the content 
should be, and how instruments would be used. All members of 
the team, junior as well as senior, contributed to this process 
with overall authority vested in the of f icer-in-charge . Once 
this was done, members of the group were assigned to develop 
selected instruments or parts of instruments. Drafts were re- 
viewed by the group, comments were made, and changes discussed 
and made'. This process continued until the instruments were 
acceptable to all members of the study group, who would be 
responsible for data analysis, as well as the Project Officer 
of OEO. 
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2. Relations with Contracting; Agency 

As a matter of policy, Greenleigh Associates v;orks closely 
with the client agency v/hich has contracted the study. There 
are three purposes for this: 

a. No proposal is so precise that it does not provide 
latitude to the evaluator. There are alv;ays unan- 
ticipated tasks which must be undertaken and planned 
activities v/hich must be adapted or discarded to meet 
real life situations. Because of this, it is neces- 
sary to keep the Project Officer informed of the 
progress of a study, the problems encountered and 
their solutions, so that no disagreement can arise 

in the future. 

b. There is alv/ays a possibility that the Project 
Officer will interpret the proposal differently 
than the evaluator. Regular reports to and dis- 
cussions with the Project Officer minimize such 
differences. 

c. Instrumtnts which are developed should meet the 
needs ot the client in terms of data covered. 
If the Project Officer has an opportunity to 
reviev; instruments, it is more likely that client 
needs will be met. 

This close relationship does not mean that evaluation will 
be slanted to meet the desires of vested interests but rather 
that there will be fewer differences of opinion about contract 
performance . 

In terms of actual relationships between the Project Offi- 
cer in each project and Greenleigh Associates, the two evalua- 
tions differed widely. In the first evaluation, contacts with 
the agency were aibnost entirely initiated by the evaluator. The 
contract reauirements, in terms of progress reports, were met, 
and meetings with agency staff or EAj. sought as joint agreement 
required In this project, the EAI Upv;ard Bound stafj. v/ere the 
project managers on behalf of OEO and maintained contact with 
the evaluators . 

In the second evaluative project, the Program Planning and 
Evaluation Office of OEO was responsible for the contract manage- 
ment not staff of Upward Bound. Most of the contacts were made 
on the initiative of the Project Officer and the contractor s 
staff had a feeling he was acting as a watch dog. He made de- 
mands on the evaluator staff which were considered beyond the 
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scope of the contract, and follov;ed the progress of the evalua- 
tion almost on a day-to-day basis. This created a feeling that 
he v;as usurping the responsibility of the project director. 
The final product, however, did not suffer and a cordial rela- 
tionship was maintained throughout the study. 



3. Project Management 

The basic requirements for evaluation are sound research 
techniques and good organization. The management of a research 
project is crucial; all of the pieces must fit together along a 
time sequence. Thus, it is important to formally or informally 
PERT an evaluation process shovring v;hich tasks are to be accom- 
plished in v/hat sequence, within v;hat time limits. All of the 
products and subproducts must be identified and time sequenced. 
VJhile a formal PERT chart was not developed for either of these 
projects, there was a time chart which shovjed how long each task 
should take, v;hen its completion was expected, as well as its 
relationship to other tasks. This made it possible for the 
officer-in-charge to determine at any critical point whether 
the evaluation was moving according to schedule. It also made 
it possible for the project director to check whether research 
or field staff v/ere adhering to schedule and contract commit- 
ments . 

Rarely, if ever, does a study move perfectly according to 
schedule or even to plan. Because the Project Officer for OEO 
took a very deep interest in the study, watched each step care- 
fully and frequently interpreted the proposal differently than 
the project staff, he often demanded that tasks be included 
which had not been originally planned. This created some un- 
easiness and apprehension on the part of the project director. 
The final result, however, v/as not marred by this intrusion. _ 
The evaluators learned to live with it, perhaps to the benefit 
of the project. 

This second evaluative study reauired the coordination of ^ 
information from a number of sources including a management inior- 
mation system developed by EAI. The OEO Upward Bound staff had 
had almost complete turnover since the first study and was in the 
process of being transferred to OE. The director of Upward Bound 
had resigned, as had other --cey i;taff. The EAI, which had been 
organized to serve Upward Bound, was in process of dissolution. 
However, the person who had been primarily responsible for the 
management information system of EAi was working closely with 
OE in transferring the information base to the latter office. 
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Since, in effect, the recipients of the final report v/ould 
be OE rather than OEO, it was necessary to v;ork closely v/ith OE. 
In fact, the data base v;hich v;as used in the study, except for 
data generated during the evaluation, v;as provided by OE using 
their computer capability and the data from EAI and other evalu- 
ative studies. In order to obtain the data it required, there 
had to be complete agreement and cooperation betv;een OE and OEO, 
EAI and the study staff. From the beginning this cooperation 
was TJresent. Uithout this joint effort, the evaluation could 
not have been accomplished. For example, one of the crucial 
requirements v.'as the use of data from a study conducted by 
Syracuse University v;hich included not only the achievement of 
Upv/ard Bound students but also of their siblings.^ Since these 
data became the basis for the cost-benefit study, the ability 
of all parties in the evaluation process to cooperate and agr'3e 
was essential. 



4. Tenor of the Conclusions 

This reliance on the cooperation of the contracting agency 
and even other agencies is not unusual in the evaluation process. 
It is often impossible to obtain access to essential data or 
even guidelines v/ithout such cooperation. An adversary rela- 
tionship between the organization being evaluated and the evalu- 
ator creates untold problems and may bias the results. The 
same may be true if cooperation is given; undoubtedly, coopera- 
tion creates an atmosphere in which the study staff are inclined 
to look with favor on the program being evaluated. This is not 
likely to be true if the Project Officer is not on the program's 
staff. Even so, the potential cooptive effect and the degree 
of cooperation on results must be realized and guarded against 
in writing reports. 

The tenor of the findings in the case of these two evalua- 
tions might substantiate that conclusion. The overall evalua- 
tion of Upward Bound in both studies v;as that the program was 
sound and the effect on the students impressive. 

The criticisms were in regard to the paucity of the program 
in relation to the estimated need and the failure of local pro- 
ject directors to insure that guidelines were followed. The 
most serious fault in the program was the failure of the host 



•^David E. Hunt and Robert H. Hardt, National and Regional 
Profile of 1^6? Upv:ard Bound Students ; National Profile of 
T967 Upward Bound Programs; ::ational and Regional Profile of 
1967 Upward Bound Programs, Syracuse Youth Development Center. 



17 

-16- 



university and the secondary school to communicate about students 
or curricula. High School teachers and the secondary school 
were largely untouched by the program. This was due to the lack 
of communication and the relatively small number of Upward Bound 
students in any one high school. 



IMPACT 

The resulting impact of the tv;o evaluations v;as largely 
negative. V/hat would have happened if OEO had remained the 
vigorous innovative agency it had been, or if the national 
emphasis on poverty Torograms had been continued, cannot be sai 
The first rei^ort, although largely positive except m relation 
to the monitoring effort of OEO, was not sufficient to Keep 
Congress from transferring the program to OE which many felt 
v/ould be detrimental since the program was not fully developed 
but wa.> still in its formative stages. The second report, 
although equally positive except in terms of the cost-benefit 
to the go-^ernment, has not resulted in any expansion of the 
program. 
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PART II: THE EVALUATIOII PROCESS 



irrrRODUCTiON 

The two evaluations undertaken for OEO of the Upv.'ard Bound 
programs had tv:o distinct purposes and, thus, tv/o different re- 
search approaches. The purpose of the first evaluation v/as to 
measure program impact -- more specifically, the impact of the 
program on the secondary schools and the community in which 
Upward Bound operated. The purpose of the second v;as to place 
the Upward Bouiid program in its historical setting and determine 
what benefits, if' any, had accrued, including cost-benefits. 
In the first study, the problem v/as a paucity of data and, in 
the second, a wealth of data v/hich needed to be analyzed and 
synthesized to determine if they were pertinent or not. 

In retrospect, it can be said that the attempt to measure 
the impact of Upward Bound on the secondary school system and 
the community was inappropriate. It is probably even an inap- 
propriate objective for a program of this size. However, the 
study staff could not have perceived this in advance. The basic 
problem v;as that the number of Upward Bound students in any 
single secondary school was too small to affect the total system 
even if all the other program guidelines had been followed 
precisely. 

One of the attributes of a good Upv/ard Bound program, as 
stated in the Guidelines , is a sizeable number from a single 
school rather than a few from a num.ber of schools. There were, 
in fact, only a few participants in any one school. In 19o8, 
there were 25,368 participants attached through Upward Bound to 
285 institutions of higher learning --an average of under 90 
per campus. These 25,368 in turn came from some 900 high schools 
an average 'of roughly 30 per school. Since some of these schools 
had an enrollment in the thousands and the Upward Bound student 
could be in four grades, the nossibility of the program having 
impact on the school was rem.ote. It was not imusual for a given 
teacher to be unaware of a student's participation in Upv.urd^ 
Bound even though he v/as covering material similar to that of 
the summer program. 

It was estimated that approxim.ately 600,000, or four per- 
"cent, of the nation's more than 13 million secondary school stu- 
dents would have been eligible to receive Upv;ard Bound benefits. 
However, in I968, fewer than 26,000, or four percent of that 
four percent, were enrolled in Upward Bound. The same was true 
for impact on the community as a v/hole. In any given community 
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the nujnber of persons involved v;ith Upv/ard Bound -- teachers, 
university personnel, parents, and students -- v/as miniscule 
in relation to the total community and in the context of com- 
peting programs aimed at the disadvantaged population. 

Even so, there is a second and more fundamental problem 
related to impact studies. If one is to measure the impact of 
any given phenomenon on an individual or institution, all other 
influences must be relatively constant or there must be a v.'ay 
to account or adjust for these influences. This is never the 
case. In any community, secondary school, or university, there 
are a number of countervailing forces v/hich affect the system 
simultaneously v/ith the program under scrutiny. ^-Jhile there 
are techniques available to adjust for other influences, sample 
size and data limitations generally preclude their use.^ For 
example, in one secondary school, it v/as reported that, since 
the Upv/ard Bound program had been introduced into the school, 
the librarian had felt frte to order a v;ider variety of books 
and provide more services to students. Superficially, there 
appeared to be a cause-and-ef f ect relationship betv/een the 
introduction of Upv/ard Bound and the change in the library. 
However, without knowing all of the influences which were_ 
brought to bear upon the librarian during the period of time 
under consideration, it cannot bo determined v.'hich factors in- 
fluenced the change. Even thoueh the librarian perceived Upv/ard 
Bound as having been the chief factor in bringing about the 
change, her own reading, the availability of new funds, or any 
number" of other factors may have played an important change- 
agent role. The evaluator cannot be too careful in interpreting 



The most common method for controlling, for factors external 
to the program under study is the establishment of a control group 
a group similar in characteristics to the program participants 
but who are not subject to the program intervention. There are, 
however tv;o basic problems related to establishing a control 
group: (1) it is frequently difficult to m.atch the characteristics 
of a participants group, and (2) unless the control group is com- 
pletely isolated from the program, which increases the problem of 
matching there may be a riiDiDle effect from the participants, 
which also affects the control group. If these two problems can 
be solved it is necessary to obtain baseline information, e.g., 
before-program data on both the participant group and the control 
group simultaneously. In the case of the study under discussion 
there were no baseline data on persons other than the participant 
group .\nother method of controlling for external factors which 
create variance is to iDrovide different treatment to defined 
participant grouiDs . It is, in effect, the corn-path method -- 
different rows of corn have different fertilizers. If there is 
a drought, however, all the corn may die and it can be inferred 
that an external factor, v/eather, not the treatment, was respon- 
sible . 
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the perception of the respondent. No definitive conclusion can 
be dravm in regard to cause and effect; one can only report 
that the program being evaluated v;as a factor of change^ or at 
least some of those interviev/ed thought it v;as. 

In the case of the second study^ the evaluation v;as of the 
total program rather than a measuring of the impact on any one 
type of organization or participant in the program. The evalu- 
ation problem related to the fact that the bulk of the data to 
be used in the evaluation v;as a fait accompli it had been 
collected. Not only v;ere the data given but they had been col- 
lected by a number of different persons for different purposes. 
These v;ere: (1) the data v;hich had been collected by EAI for 
the Office of Economic Opportunity; (2j the data generated by 
the Syracuse University Youth Development Center for the pur- 
pose of their project; and (3) the OEO-CAP Management Informa- 
tion System data. In addition^ there v;ere data from some 13 
studies v/hich previously had been undertaken to evaluate Upv;ard 
Bound. Although some of these used a common data base^ the 
three basic data sources v;ere not necessarily compatible. The 
most serious problem v;as in relation to the cost-benefit study. 
No control group had been planned and it v;as necessary to use 
v/hat could be obtained from available data in developing the 
cost-benefit methodology. 

Against the background of these tv;o major problems^ which 
affected each of the efforts differently^ the methodology and 
research techniques used in these studies are discussed in detail. 

B. THE FIRST STUDY 



1. Site Selection 

In a nationv;ide study v/ith limited resources^ no sample of 
communities can be large enough to be a statistically valid ran- 
dom sample. In order to have coverage as wide as possible^ it 
was planned to study l6 communities intensively with on-site 
field v;ork and to mail a questionnaire to roughly one-third of 
the remaining high schools v/ith Upv/ard Bound students. A sample 
of the l6 communities had been predetermined at the time of the 
proposal preparation. This was a number v;hich could be encom- 
passed v;ithin the estimated budget^ and which would allov: selec- 
tion of communities in each of the regions to represent different 
ethnic populations enrolled in the program. The criteria for the 
selection of the communities v;as to assure that significant num- 
bers of blacky Chicano^ v;hite and American Indian were included 
in the sample and all geographic areas covered. No attempt V7as 
made to include rural areas. The communities chosen v;ere: 
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Boston, Massachusetts; Hartford, Connecticut; Pittsburgh, Penn- 
sylvania; Morehead, Kentucky; IlashviLle, Tennessee; Tampa, 
Florida; Detroit, Michigan; Cleveland, Ohio; St. Louis, Missouri; 
Little Rock, Arkansas; Ifev; Orleans, Louisiana; El Paso, Texas; 
Billings, Montana; Phoenix, Arizona; Oakland, California; and 
Los Angeles, California. 

The selection v;as done jointly by EAI and Greenleigh 
Associates after studying program and participant data. In 
each of the coniniunities in the sample, high schools v;ere chosen 
to be included on the basis of having the largest number of 
Upv;ard Bound students. Hov/ever, in order to assure that Ameri- 
can Indians would be represented, the Phoenix Indian High School 
and Union High School, in Phoenix, Arizona, viere included. In 
some communities like' Billings, Montana, there v/as no choice to 
be made because only one high school had Up'.rard Bound students. 
In large metropolitan areas like Boston and Detroit, the high 
school choice was based on the numbers in the high school. 

The basis for this decision followed the rationale of the 
Guidelines , e.g., if more Upward Bound students were enrolled 
in any given high school, there would be a greater probability 
that the immct of the program could be perceived. This method 
of selection also provided the desired ethnic and geographic 
mix. The purpose of the mix was to determine if there was a 
difference in uie iiapacc because of the ethnic background of the 
majority of the students or the geographic region in the country. 
The 277 high schools chosen to receive the mail questionnaire 
were chosen at random using similar criteria to test the random- 
ness of the sample. 



2. Developing the Instruments 

The field instruments developed v;ere designed to be used 
bv skilled data gatherers. They were not carefully worded ques- 
tionnaires which demanded that the interviewers ask the questions 
as v/ritten in the same sequence in each interview. Rather, they 
outlined the information v;hich was to be obtained in the inter- 
view and left the order of questioning to the field analyst or 
the respondent. The purpose was to create an interview climate 
in v;hich the respondent felt at ease and free to express himself 
candidly. The field analyst was responsible for getting the 
responses and v/riting utd the interview. This method does not 
provide "hard" data in the sense that a given percentage answer 
>es'' to a given question, but rather "soft" data which get at 
perceptions, feelings about the program, and its general cli- 
mate. Frequently, the respondent reveals attitudes and feelings 
he did not intend to show." This is important in an evaluation 
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which relies heavily on the perceptions of individuals rather 
than on statistical data. In this case, the N v/as too small to 
subject the data to rigorous statistical analysis. 

Conversely, the questionnaire v;hich v;as designed for the 
mail survey v;as a brief, straightfor.-zard instrument v;hich re- 
quired a minimum effort on the part of the respondent and asked 
for hard data, e.g., number of students in Upv/ard Bound, number 
of teachers involved vJith Upv;ard Bound students, changes in 
curriculum that had been made as a result of Upv/ard Bound, num- 
ber of contacts with staff of host colleges, etc. 

Hard data, comparable to those elicited in the mail survey 
were obtained by field analysts in each school from the princi- 
pal, other administrators, ^nd teachers, e.g., nvimber of stu- 
dents, contacts v;ith the host university faculty, etc., as dic- 
tated by a data checklist which each field analyst was responsi 
ble for collecting. Data on students -- grades, dropouts. Up- 
ward Bound status, and other student-oriented information — 
were available through the data bank. 

The final step in the planning process v;as the training of 
the field staff. Field staff consisted of field analysts v;ho 
had had numerous data-gathering and interviewing experiences. 
The purpose of the training was to orient them to the purpose o 
the study, the sources of datr., and the use of the instruments, 
rather than to provide them with specific techniques. Field 
analysts were instructed to interview and collect data from se- 
condary school personnel, university personnel, high school 
students, and community leaders. 



3. The Field Vfork 

Once the training v;as completed, field analysts v;ere as- 
signed to the 16 comjnunities with instructions to contact the 
appropriate high school, university, and community personnel. 
Each member of the field staff was assigned to four cities and 
was responsible for interviewing persons at six levels in each 
of the communities. These included the Upward Bound director, 
the high school princit)al and other administrative staff, gui- 
dance counselors and faculty who had contact with Upward Bound 
students, selected university staff, and community leaders. 
This presented a serious problem of obtaining appointments and 
scheduling, since all interviews had to be completed within a 
two-week period. 
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Although Jpv;ard Boiand project directors in each community 
had been apprised jf "'/ne .tudy by the national OEO staffs there 
v;as no assurance that o\ier persons involved in the study had 
been notified. Thus- field staff were responsible for con- 
tacting the rrincipai in each of the target high schools and 
securing his" cooperation as ^^/oil as that of his staff. This is 
frequently a delicate unde. making. Public schools^ in parti- 
cular^ are likely to resist outside evaluators. Part of the 
skill of field staff is to reassure the principal that data 
will be kept confidentia] and not be used in a v/ay v/hich can 
identify the school, ^o^ ' .nity leaders, university personnel^ 
and high school teachers, v:ith the principalis permission, are 
more accessible and completing the field v/ork is a matter of 
scheduling and locating^ the appropriate respondent. 

The interviev;, as has been indicated, v/as structured but 
non-directive structured in the sense that certain topics 
had to be covered; non-directive in the sense that the respon- 
dent was allowed to talk about the subject in any way he chose 
and in any order. The interviewer was responsible for keeping 
notes v;hich would allow him to write up the interview once xt 
was completed. The field analysts were instructed to do this 
immediately following the interview in order that memories were 
as fresh as possible. This non-directive technique is one wide 
used by therapists. 

The follov/ing persons were seen: 

1. The Upward Bound Project Director and other members 
of the local program staff. 

2. The principal and other key administrators from at 
least two secondary schools that had students par- 
ticipating in the local Upward Bound program. 

3. Guidance counselors, faculty members, and super- 
visors who had contact with Upv/ard Bound students 
in these high schools. 

h. A small sample of Upv/ard Bound students enrolled 
in the selected secondary schools. 

5. Selected university staff members who had parti- 
cipated in the Upv/ard Bound summer program. 

6. A number of community leaders, including public 
education officials, community action officials, 
members of Upward Bound advisory groups, and 
leaders of local neighborhood groups. 
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Follov;ing is a breakdo^vn by category of the 44? interviev/s 
completed : 

Secondary school personnel 132 
University personnel 91 
Students 158 
Community leaders 66 



4. The Analysis of the Data 

This was the third phase of the study. Once the field v;ork 
was completed^ field staff were brought in for a debriefing 
a process lasting several days to share their insights and 
information v/ith the project director and research analysts who 
would be responsible for the final report. In addition., each 
field analyst v;as responsible for developing an analytical- 
descriptive report on each of his communities. 

In planning the study^ it v/as inferred that evidence of 
impact on the secondary schools v;ould take the form of change 
in curricula; change in acquisitions or use in the library; more 
intensive work^ either by teachers or counselors^ with under- 
achieving students with potential; change in methods of recog- 
nizing student pot'=^ntial^ or other means of motivating students; 
evidence of follow- through in the high school program of studies 
or methods used at the host university during the summer; or 
evidence of changed attitudes toward disadvantaged students. 
However^, unless there is good baseline data., it is frequently 
difficult to determine if change has taken place in any of the 
above areas. 

If actual curricula descriptions or plans are available 
before and after the program,, it is possible to see if change 
has taken place. If that change is consistent with methods or 
materials used in the program and if the teacher says that was 
the reason the change occurred^ it is possible to infer impact 
on curricula. Similarly, if there are lists of library acquisi- 
tions and library use before and after., it is possible to deter- 
mine if change has occurred. This is concrete evidence. How- 
ever, perceptions of changes in recognizing student potential, 
motivating students, and work with students, barring any con- 
crete evidence, are soft data. Furthermore, perceptions of what 
has occurred over time tend to be unreliable. However, • if there 
are no "pre" data the researcher has little choice but to rely 
on "soft^' data. If this is the case^ the limitations of the 
data must be stated. 
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Even if there are pre and post data^ the kinds of data 
which can be generated through reviev; of materials^ inter^/iews^ 
and observations on most of the above data are not subject to 
rigorous statistical analysis. This is particularly true if 
the research covers a number of sites or geographical areas. 
Frequently the unit for neasurement differs from place to 
place. For example^ use of library may be counted on an hourly^ 
daily ^ or v/eekly basis ^ or on a person basis. In the first 
case^ any given person v/ho uses the library several hours ^ days 
or v;eeks v/ould be counted several times. In the second case^ 
no person v;ould be counted more than once in a given time period. 
It is usually impossible to reconcile these tvro methods. 

A measure of change in attitude can be made subject 
to statistical analysis only if the same instrument is adminis-- 
tered before and after. The value of the analysis is good only 
if there is a valid instrument. In the case of this study^ no 
such pre and post data were available and it v;as necessary to 
rely almost entirely on the interviev; data^ secondary materials^ 
or curricula used^ etc. Thus the analysis of the data on the 
impact of Upv/ard Bound in secondary schools did not involve 
rigorous statistical methods. 

The same was true for measuring the impact of the program 
on the community. Evidence of impact could only be in terms of 
increasea community awareness oi the potential of disadvantaged 
students^ the establishment of new programs^ increased support 
of old programs to identify and assist the underachiever ^ changes 
in attitudes among community leaders^ etc. 

The data collected v;hich might have been subjected to some 
kind of scaling or measure of deviation from central tendency 
were too minimal to use even the most common statistical mani-- 
pulations. Thus^ the report was descriptive-analytical rather 
than statistical or sociometric. 

The total import of the data^ except for some isolated 
cases involving individuals in the school system or the commu-- 
nity^ showed that there was no impact on either the high school 
or the community. At the same time^ the impact on the students 
involved in the program^ although not under study^ could not 
fail to be noticed. The field reports did^ however^ reveal the 
following: 

1. Th^ percent of Upv/ard Bound students in any given 
school was too small to have any impact on the 
general student body. 
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2. Although some teachers reported changes in library 
acquisitions and curricula, they were reluctant to 
attribute this to Upv/ard Bound. The most frequent 
change reported v;as the acquisition of books on 
black history or the introduction of a black history 
course. Hov/ever^ since the study v^as being carried 
out at a time v;hen the demands for such courses v;ere 
at a peak^ it is unlikely^ given other findings 
that Upwaid Bound by itself could have brought about 
the change . 

There vrere isolated schools in which teachers^ v;ho 
had taught in the summer Upward Bound program at 
the local university^ were trying new teaching 
techniques and programs. This was due to a link 
v/ith the host university which did not exist in 
most communities. 

3. There was little or no communication between the 
Upv7ard Bound staff and the faculty of the host 
university or college with the secondary school 
staff. The greatest degree of communication v/as 
betv/een counselors and Upward Bound staff and it 
was in regard to counselors that the greatest 
impact was reported. 

Quotations from the final report illustrate the analytical 
descriptive approach. For example: 

In about half of the schools visited., guidance counselors 
had worked closely with Upward Bound project directors 
and staff members in recruiting students for the Upward 
Bound program. The counselor felt that this had brought 
about a definite change in her counseling procedures. 
The recruitment effort brought her into personal con^cact 
with many more of the parents and_, as a consequence^ 
she felt she had come to knov; the students much better. 

or. 

All high school principals spoke about changes in curri- 
culum and in some of the policies in their respective 
high schools. Only four out of 36 principals would 
acknowledge that Upward Bound had specifically stimulated 
any changes. One reported that rules had been relaxed 
to allow students from the local college to come into 
the high school to work with Upward Bounders. Afro- 
American history and culture courses had been introduced 
in a number of high schools but one principal pointed 
out the difficulty in finding qualified teachers who 
know something about African culture. 
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There was, ho\-tever, some quantification: 

Of the 36 high schools visited in this study, only four 
had offered faculty members or Upward Bound staff an 
opportunity to discuss the summer program with the fulx 
faculty. 

The results of the impact on the community were similar. 
The primary contacts in tir^. community were with the local Commu- 
nity Action Agency members on the Upward Bound Advisory Commit- 
tee and heads of agencies like Urban League, community renewal 
proiects, school board members, parents, and city councilmen. 
Their responses to the impact of Upward Bound on the communxry 
and school programs were also "soft." As in the case of col- 
lecting data from school personnel, analytic-descriptive tools 
were used for reporting community links with Upward Bound io 
the extent feasible, the scope of a given response among the 10 
communities was reported as follows: 

Almost all of the people interviewed in the communities 
were positive in their judgment of Upward Bound. They 
were encouraged by the increasing number of young people 
who were attending college. The progcram seemed attrac- 
tive because vouths who they felt nad not been getting 
J, f-^A^ ■^^r.o^r nn h±<zh school were now receivojig attention. 
Many people" feit the program should be expanded. There 
was almost a unanimous feeling among the community 
leaders interviewed that there were many more youngsters 
who could profit from Upward Bound but that the serious 
lack of funds for the program kept them from partici- 
pating. 

In five cities a number of persons interviewed made 
comments doubting the sincerity of school board mem- 
bers They noted "a lot of lip service, but no real 
action " In many cases it was clear that there were 
serious doubts regarding the commitment of the educa- 
tional leadership to expand educational opportunities 
for the disadvantaged. 

The results from the mail questionnaires were tabulated and 
tests of significance were run to determine if there were diffe- 
rences in reported impact whicn were due to any predominent _ 
racial characteristic of the school or due to the location, i.e. 
Srban/rural Kov.-ever, there was less than a 50 percent return 
on qSesSonAai?es mailed (95 out of 207) and the N was too small 
to be conclusive. 



28 

-27- 



A-iother aspect of the descriptive analysis was the nature 
of communication within the program. The Guidelines imply con- 
siderable intercommunication betv;een the host agency, ^i-'ffr- 
sitv or CAA, the public school system, the Upward Bound stafx, 
the high school faculty, the parents, the c°™^ty, and the 
advisory corrjrattee. The analysis, agaxn, relied on the reports 
of the resTJondents and could not be statistically manipulated 
because of * the small 11 and the nature of the data. The report 
took the form: 

Of the university faculty members interviewed, less than 
10 percent had made any contact with secondary school _ 
teachers, nor did they see this as a meaningful experi- 
ence In cases where there had been meetings, they had 
been 'sporadic and not very useful. Some college faculty 
refJectea a lack of confidence in the secondary schools 
and their teachers. One professor said, I'm not im- 
pressed with most high schools here or with the staff 
from these schools." Another felt that there were bad 
feelings between \miversity and high school teachers 
because the high school teachers get paid as ^ much, and 
sometimes more, than the university faculty. 

Efforts by secondary school personnel to establish mea- 
ningful communications with the community had been 
m nimai In four cities, PTA was mentioned but it was 
quickly 'noted that, especially in large cities teachers 
rarelv attend meetings of these groups. A number of _ 
respo->ses in four cities showed a discouraging insensi- 
tivitv on the part of some teachers and principals to 
what "was happening in the immediate vicinity of their 
schools Several people noted that teachers and princi- 
pals are increasingly moving to suburban areas and, 
therefore, are no longer part of the communities m 
v/hich they work. 

In two cities, people expressed their belief that the 
schools purposely avoided meeting and working with lea- 
ders of the black community and that there was little 
communication except in time of crisis. Then, it was 
felt the school administration turned to the black 
leadership to help "keep the lid on things. 

What the evaluation accomplished was to point up the 
strenFth-^ and weaknesses of the Upward Bound program as a change 
a^en? BasSd on the findings of the study, a model Upward Bound 
p^ogr^m, as well as recommendations, were included m the report. 
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In the case of this study the v/rong questions v;ere asked^ 
or rather the wrong group v;as chosen to measure, impact. As has 
been said^ the number of llpv;ard Bound participants in most high 
schools or communities v;as much too small to impact either. In 
a city like New York^ v/hich was a study site^ a program would 
need a large number of participants to affect change. Hov/ever^ 
during the course of the study ^ participants were interviewed 
to determine whether or not they perceived change in the high 
school or community due to Upvrard Bound. The positive impact 
of the program on participants coula not be escaped despite 
the fact that that impact was not a part of tho study. In this 
sense ^ the study v/as weak. 



THE SECOiro STUDY - THE EVALUATION 0? UPWARD BOUITD 196^-1969 



1. The Data 

The methodology used in the second evaluation in relation 
to the collection of primary data v;as similar to that used in 
the impact study. The purpose of this evaluation was to provide 
a history and an assessment of the program v;hile it was under 
the auspices of the Office of Economic Opportunity. Primary 
da'ua Were ^^-onctrca zo assure ohat all activities v;ere covered 
up to June 30^ 1969^ when the program v/as transferred by an Act 
of Congress to the Office of Education. 

The primary sources of information were all of the available 
research/evaluations of the Upward Bound program v;hich had been 
undertaken to date. Other sources of information included data 
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which had been generated by Upv;ard Bound programs through the 
OEO-CAP management information system^ and the data retrieval 
system developed by EAI. The data included the names of all 
host agencies; the high schools from v;hich Upv/ard Bound stu- 
dents came; the numbers and basic socioeconomic characteristics 
of these students^ and their educational achievement; program 
participation; and for those v;ho had finished high school^ 
current status^ e,g,^ not in college^ in college^ and-, if in 
college^ academic achievement. In addition to these data^, 
Syracuse University had gathered information on the characteris- 
tics of summer Upv;ard Bound programs for three years. These 
data included information on the students' families and siblings 
v;hich proved to be the best data source for the cost-benefit 
study. 

In addition^ the studies measured changes in attitudes and 
motivation in the follovring areas: 

1. Motivation for attending college 

2. Importance and possibility of college graduation 

3. Self-evaluation of intelligence 

4. Interpersonal flexibility 

5. Self-esteem 

6. Internal control 

7. Future orientation 

8. Alienation 

The Syracuse studies v;ere done in three cycles. The first 
two included a sample of 21 programs chosen at random^ involving 
1^622 students. The third year cycle included 24 programs and 
1,797 students^ and a control group of 1^,448 students from the 
24 feeder high schools. Other data included written field reports 
and reports of project directors and similar materials. 

The only primary data used in the Greenleigh evaluation v/as 
obtained by field work in 22 communities v;hich followed a pat- 
tern similar to that of the impact study. The purpose of this 
was to update data on program operations^ not student charac- 
teristics. The sample v/as selected on the basis of college size^ 
regional location^ urban-rural character^ ethnicity^ quality of 
program^ whether typical^ innovative^ or troubled^ and the fre- 
quency of program visitation during the past year. The selection 
was made by the OEO project manager in consultation v;ith Upv/ard 
Bound staff from the OEO national office^ and the Greenleigh 
Associates project staff. 
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Each of the 22 programs v;as visited and observed for five 
days by trained field analysts. Considerable data v^ere generated 
from overview reports and interviews conducted v;ith past and 
present project directors^ university and secondary school 
instructors^ guidance personnel^ tutor-^counselors^ students^ and 
the admissions staff of the host institution. -Special inte*>"viev; 
schedules and interviev^ guides v;ere developed for this purpose 
and the resulting data were coded^ tabulated^ and analyzed. 

This sample v/as then com.pared with the current universe of 
301 Upv;ard Bound programs to validate its representativeness. 

The la.st data source was interviev;s v;ith persons who had 
played significant roles in the development of Upv/ard Bound. 
Since genesis and development of the Upward Bound program occu- 
pies a unique position in the history of the antl -poverty program^ 
it v;as considered vital to obtain a global understanding of the 
program from the persons v;ho v/ere involved in the early stages, 
and v;ho administered^ decided policy^ monitored^ and directed 
the program. From a long list of such persons^ three-- t^^ six-- 
hour in-depth interviev;s v;ere conducted v/ith all of those v;ho 
had had significant impact on the developm.ent and implementa- 
tion of the national program betv/een 1965 and 19^9 . The inter- 
viev/s v;ere based on comprehensive interviev; guides created for 
each area of program history. 

In terms of the difference betv;een this evaluation and the 
foriaer measurement-of -impact study^ there were two fundamental 
differences. This evaluation contained considerable hard data 
in terms of characteristics of Up^.;ard Bound student sj and extent 
to which students met the criteria of poverty ^ grade point 
averages; characteristics of families in terms of family income; 
and Upv:ard Bound participation. For those students who had 
left high school^ there v:as considerable data on college enroll- 
ment and retention. 5 These included data on the type of college 
attended^ grade point average^ and characteristics of college 
enrollees. The analysis^ again^ did not involve sophisticated 
statistical analysis but rather a report of the data. Former 
researchers had subjected the data to statistical tests of sig-- 
nificance or deviations from mean. 



David E. Hunt and Robert H. Hardt., op cit., Characterization 
of Upward Bound Studies : Sunner I966 : and National and Regional 
Profile of 19q7 Upward Bound Students . 
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The computer used to generate the data belonged to the Of- 
fice of Education and the data to be generated and the statis- 
tical manipulation was a joint decision of the study staff, the 
Project Officer, and the Office of Education. Trends v;ere 
examined in terms of the three-year data span, and it was found 
that there was little change, except in terms of the decreasing 
number of black students v;ho enrolled in black colleges betv;een 
1967 and 1969^ greater proportions of the black students were 
enrolling in predominantly white institutions. 



2. Cost/Benefit Analysis 

The most rigorous analysis undertaken v;as the cost/benefit 
study. This presented a number of analytical problems which 
required solution. The essence of the cost/benefit analysis 
method consisted of: (a) determining, logically, the categories 
of costs of a project and the categories of benefits that might 
flow from itj (b) collection of data on the costs and benefits 
and assignment, insofar as possible, of a dollar value to these 
costs and benefits; and (c) comparison of the difference be- 
tween benefits and costs, or of the cost-benefit ratios, for 
alternative methods of achieving the desired goal. The study 
did not attemTDt Part (c), for it did not make a cost/benefit 
study of alternative ways of achieving the goals of the Upvmrd 
Bound program. The best thai: the Soudy could do was to indi- 
cate v/hether the benefits of Upward Bound appear to exceed the 
costs and, if so, by how much. Until alternative programs are 
similarly examined, it will be impossible to say whether this 
program represents the best expenditure of the taxpayer's money 
to achieve objectives such as those sought by Upward Bound. 

The cost/benefit analysis was performed by Dr. Walter I. 
Garms (Assistant Professor of Higher Education, Teachers College 
Columbia University) and the detailed description of the metho- 
dology used, which follows, is quoted almost verbatim from his 
discussion of methodology: 

Any attempt to do a cost/benefit analysis of a social 
program is beset with the necessity for so many guesses 
and approximations that results can be, at best, only 
tentative. This study points out the areas in which 
such guesses and anproximations were necessary, but 
the magnitude of the errors involved was usually un- 
known so that it is difficult to know whether or not 
the errors known to be on one side counterbalance those 
kno\m to be on the other side. In addition, there are 
a number of benefits and costs that are not measurable 
in dollars, and, therefore, could be brought explicitly 
into the analysis. These extremely important caveats 
must be kept in mind, 
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The first important task in the costA>snefit analyses v;as 
to determine the point of viev; froin v/hich it v;as to be done. 
The point of viev/ affects the costs and benefits to be measured 
and the manner in which they v;ill be treated. There are at 
least four points of viev; V7hich v;ere considered in the formula- 
tion of this analysis. Tv;o of them v/ere adopted: benefits and 
costs to the individual; and costs and benefits to society as a 
whole. Those excluded v;ere: costs and benefits to the govern- 
ment viev/ed as a profit-maximizing firm; and benefits and costs 
to the government thought of as a firm v/ith a social conscience. 

Once the point of viev; of the study had been determined the 
question of a control group v;as confronted. This vras needed in 
order to determine v;hat changes had taken place in the Upv/ard 
Boiand student compared to those v;ho had not been in the program. 
Only data already available could be used for this purpose. 
Two previous cost/oenefit studies of Upv/ard Bound had used popu- 
lation averages as an implied control group. Another study had 
capitalized on the data available and used older siblings as 
the control. The latter method v:as used in this analysis; re- 
fined by pairing Upv/ard Bound students v/ith older siblings of 
the same sex and controlled for more than one older sibling. 
If a v/hite female Upv/ard Bound student had an older sister v/ho 
had dropped out of high school and another v/ho had completed 
high school^ one-half a person v/as added to the sibling cate- 
gox'y X c:uica,x^ ux'opouo^ diiu Oiiu— iio/lx wao addGu oO tiie sib- 

ling category "v;hite^ female^ graduated from high school," The 
rationale for this approach v;as the fact that the sibling should 
best approximate the Upward Bound student^ if sex v/ere controlled^ 
in term^ of family and community environment and intelligence^ 
and the tv/o v;ould have^ in most cases^ attended the same schools. 
Also account was taken of all older siblings of the same sex^ 
but SI lings from larger families did not exert extra influence 
on the study. The data for this pairing v/ere available from the 
EAI data bank and data generated by Syracuse University Youth 
Development Center . 

It is recognized that certain biases are introduced by this 
method. First., there is the fact that it excluded all students 
who do not have an older sibling of the same sex. This tends 
to exclude students from small families^ and it is possible 
that these students would exhibit superior performance because 
of the additional parental attention they get. Second^ it ex- 
cluded Upv/ard Bound students from families so disorganized that 
the student really does not knov/ how much education his older 
siblings have obtained. The bias here would be the opposite 
of the one above. Third^ it excluded students because data on 
them v/ere not both in the Upv/ard Bound master files and in the 
Syracuse files. There v;as no way of knowing what biases^ if 
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any, v;ere introduced because of this, but it was assumed that 
those omitted were omitted in a random fashion, so that no bias 
resulted. Aside from the above sample problems one could ques- 
tion the assumptions that the older siblings are of the same 
race, socioeconomic status, have the same family and community 
influences operating, and have the same intelligence as their 
Upward Bound siblings. Cf these, it seems likely that only one 
is apt to be biased in a particular direction. It may >;ell be 
that the Upv;ard Bound students are, on the average, more intel- 
ligent than their siblings simply because they are'a selected 
group. Students similar in all other respects except that they 
were not as intelligent as their siblings might never have been 
selected for the program. To the extent this effect ouerates, 
and it could be an important one, benefits are overstated. 

Out of a total of 23,333 Upward Bound students in the master 
EAI data files, there were 7,236 who had older siblings of the 
same sex and for whom data were complete and matched in the tw9 
data sources. Each was classified by race, sex, and current 
educational status, e.g., v/hite; m?le; and dropped out of high 
school; still attending high school, completed high school, not 
in college; one to three years of higher education, not atten- 
ding; one to two years of junior college, still attending; com- 
pleted college. Siblings v;ere similarly classified. o 

Present educational attainment was not the important thing. 
What was important v/as how far these students (and their sib- 
lings) would ultimately go in school, since income potential is 
heavily correlated with education. Hov/ever, data relating edu- 
cation CO income are only available in broad categories (one "^o 
three years of high school, four years of high school, one to 
three years of college, four or more years of college), so 
assuir.ptions './ere made about the ultimate placement of Upward 
Bound students and their siblings in these categories. In doing 
this, the findings of the earlier study were used regarding 
dropout rates for Upward Bound students and their siblings. 

A third general area in v;hich a decision was important was 
the selection of a discount rate to be applied. LifetLme ear- 
nings, the metric used for determining benefits, are sensitive 
to the discount rate applied, i.e., the determination of the cur- 
rent value of a stream of X dollars to be obtained Y, Y+1, 
Y+2..., etc. years hence. Three discount rates v/ere" chosen: 
five percent, 7.3 percent, and 10 percent. Tne 7.5 percent was 
the current rate of prime municipal bonds; 10 percent represents 
a presumed preference for earlier income somewhat inconsistent 
with the current borrowing rate; and five percent, the utility 
function which the government might regard as a desirable social 
rate of discount . There is reason to believe, whether correctly 

^ Hunt and Hardt, Ibid. 
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or not^ that individuals operate on the high side of the costs 
of money and that govermients operate on the low side. Hence^ 
the reason for the parametric approach taken here. 



Finally^ the categories of costs and benefits v/ere deter- 
mined. Benefits to the individual considered v/ere the follov;ing 

1, Increased lifetime income as a result of the Upv;ard 
Bound program. Of course^ the individual v;ould not 
have use of all of this increased income^ for he 
would be forced to pay income taxes on it. One 
could either reduce the prospective income by the 
amount of the taxes^ or include the taxes separate- 
ly as a cost. The latter course v/as chosen. This 
illustrates a problem having to do v;ith cost/ 
benefit ratios. The ratio v/ill be different depen- 
ding upon v:hether taxes are shovm as a reduced 
benefit or as a cost^ although the dollar diffe- 
rence' betv;een benefits and costs v;ill be unaffected. 
This should be kept in. mind when looking at 
costA^enefit ratios. 

2, Stipend received v/hile in the Upv/ard Bound program, 

3, Scholarships and grants received while attending 
college, ihese also can be looked upon as a bene- 
fit or as a decrease in the cost of attending 
college . 

4, Value of the option of obtaining further education^ 
which is passed up if one drops out of high school. 

5, Intangible benefits^ that is^ benefits to v/hich it 
is difficult or impossible to assign a money value. 
These might include satisfactions derived from the 
process of education itself^ the opportunity to 
escape from the ghetto^ increased enjoyment of 
literature and the arts^ and so on. Perhaps im- 
portant to f or/:ard--looking individuals is also the 
increased opportunity that their children v;ill have 
for higher education. 

Categories 1 through k were quantified. 

Costs to the individual considered included the following: 

1. Tuition cost of attending college. 

2. Extra living costs associated with attending college. 
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3. Unemployment benefits not received as a result of 
being more fully employed during his lifetime. 

4. Welfare payments not received for the same reason. 

5. Additional taxes paid on the additional income 
received during his lifetime. 

6. Foregone earnings while attending high school and 
college. 

7. Intangible costs. This v/ould include^ among other 
things^ the loss of leisure time that he would 
otherwise have while unemployed. 

While only categories 1 through 6 were quantified, each 
of these costs and benefits v;ere considered individually^ and 
the source of data^ the method of calculation^ and the cautions 
to be observed in interpreting the results v/ere described in 
the final report. 

a. Lifetime Incomes and Differentials Due to Upward Bound 

By far the most complicated problem was that of estimating 
present value of additional lifetime incomes associated v/ith 
the increased education thaz resul^cs from the Upward Bound pro- 
gram. It v/as clearly not feasible to v;ait for 50 years to find 
out the actual lifetime incomes for those in the program^ so it 
was necessary to attempt to use current cross-sectional data as 
a substitute for longitudinal data. The best and most recent 
data are those mentioned earlier of the U.S. Bureau of the Cen- 
sus^ giving incomes for individuals in 19^7 with varying de- 
grees of education at different ages. The assumption is then 
made that these incomes for different age groups at this point 
in time represent the incomes for a particular group at dif- 
ferent points in time as they reach these ages. This is clearly 
a tenuous assumption, but the best that was available without 
waiting. 

The use of these data affected the results to tne greatest 
extent in terms of the black male. Income data available re- 
flected past employment practices in relation to the black 
college-trained male. At the time of the study and since, this 
pattern has changed markedly; the black male is in a much better 
competitive status in the labor market and earnings thus can be 
assumed to be higher than those used in this analysis. 

No attempt was made to correct for the effects of inflation 
by converting to constant dollars, since the data were all for 
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the same time period. It was assiimed that future income of all 
v/ould be affected to the same degree if the value of money 
changed. If it v;as decided^ hov/ever^ that the inflation/def la-- 
tion V70uld effect the income of various groups differentially^ 
it would be necessary to convert to constant dollars. 

To v/hat extent might the present distribution of income 
represent what will happen over the next 50 years? One thing 
that is interesting to note is that the streams of income for 
all levels of education shov; a characteristic increase for 
some years; but., for the last 10 to 20 years before retirement^ 
they shov; a slov; decrease. However^ on the basis of everyday 
experience^ it seems unlikely that the salary rates of indivi-- 
duals are reduced during this period. Rather^ it seems that 
they probably reach a plateau and tend to stay there. The 
tailing--off observed could be the result of increased sickness 
as individuals get older^ so that they are less able to v;ork 
full time. Or^ it may represent the fact that these individuals 
who are nov/ older are to a great extent obsolescent. Not only 
did their formal education occur a long time ago^ but in recent 
years (as retirement age approaches)^ it has not been financially 
attractive to them to seek retraining. This does not mean that 
their salaries have been decreased^ but rather that they have 
stayed on a plateau and have not shared in the increases that 
have come to younger age groups as a result of the expansion of 

Another factor that was included in the benefit calculation 
is the constant increase in real incomes. Miller has sho;m that 
real incomes in constant dollars are indeed increasing with the 
passage of time. 7 It appears that this rate of increase has been 
in the neighborhood of three percent per year for a number of 
years. One may derive this from Miller's figures or^ alterna- 
tively^ from the fact that productivity has increased at appro- 
ximately this rate for the past 20 years. This means^ then, 
that an estimate of lifetime incomes that does not take this 
expansion of the economy into account v/ill be seriously under- 
estimated, V/hen economic growth is taken into account^ earnings 
after about age 50 tend to reach a plateau and stay there. 

An individual is not concerned with v/hether the economic 
growth^ which he sees reflected in the annual three percent rate 
of growth of the economy^ is "caused" by this additional educa- 
tion (some may be^ but not all of it). He is only interested in 



Herman P. Miller^ "Lifetime Income and Economic Growth/* 
The American Economic Review, LV:4c^ September^ 1965^, PP, 21-43. 
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the fact that he will share in it. Thus., it is appropriate to 
use estimates of lifetime income that include this factor of ^ 
the expansion of the economy for estLmating individual benefits. 

However^ there is another factor that must be taken into 
account. The individual must ask himself v;he her^ realistically., 
he can expect to earn the incomes which census figures show are 
associated with increased educational attainments. We know 
that there is a high correlation between socioeconomic status 
and amount of education obtained. To an unkJiovna extent^ then, 
the differences in income may be caused not by education^ but 
by effects of nepotism and social connections, m addition^ it 
is undoubtedly true that^ on the average^ those v/ith more innate 
ability are likely to obtain more education. Thus^ we have the 
problem of trying to decide hov; much of the income differentials 
are caused by education and how much by other factors. There 
is certainly no question that Upward Bound students had^ on 
the average, fev;er social connections and less opportionity to 
profit from' nepotism than the average student. Denison has 
faced the problem squarely and has used a figure of 60 percent 
as representing the proportion of income differentials that can 
reasonably be said to be caused by education.^ 

It is very difficult to establish just what the appropriate 
figure should be^ for when there is joint causality it is often 
practically impossible to untangle the causes. However^ those 
who would argue that Denison underestimates the value of educa- 
tion must be prepared to reconcile their vie\';points with fin- 
dings of a number ox recent studies showing socioeconomic status 
as a much m.ore important determinant of school achievement than 
measures of school effect. 9 On the other hand, a study by 
Guthrie, et al. surveys some recent, and mostly unpublished li- 
terature, and concludes that the figure of 60 percent ^^y be a 
minimum percentage to represent the effect of education. -^^ 



Edv:ard F. Denison, The Sources of Economic Growth in the 
United States and the Alternatives Before Us , Supplementary paper 
No. 13, V/ashington Committee on ii;Conomic Development, 1962 . 

^Jesse Burkhead, et al.. Input and Output in Large City High 
Schools, Syracuse University Press, 19o7; James S. Coleman, 
et al.. Equality of Educational Opportunity , U.S. Office of 
T^irinn^tiQn^ lOpo: Torsten Husen (ed\). International Study of 
Achievement in Mathematics , John Wiley and Sons, New York, 19o7. 

•^^James V[. Guthrie, et al.. Schools and Inequality , The Urban 
Coalition^ V/ashington, D.C., 19o9. 



39 

.38- 



All serious investigators agree that there is^ as yet^ no 
sure v;ay to separate the effects of education from those of in- 
nate ability^ social connections^ and other factors. Here^ 60 
percent of the income differential has been chosen as represen- 
ting the minimum v/hich can be ascribed to education. Obviously^ 
100 percent of the differentials represent the maximum thau 
could be ascribed to education^ and 80 percent represents an 
in-betv/een position. 

There are some other problems associated with the deter- 
mination of income differentials. If one is interested in the 
differentials caused by education^ one should presumably be 
interested in the differentials in earnings^ not in income. 
Hov/ever, there are no reliable data available since i960 on 
earnings. And even these v;ould not tell the v;hole story^ since 
people can invest earnings and thus get unearned income that 
comes ultimately from the earnings that v;ere associated v;ith 
education. In any case, since this study is concerned v;ith dif- 
ferentials, one can presume that the income differentials v;ill 
be rather similar to the earnings differentials. This v;ill not 
be strictly so, for there is more unearned income in the income 
of the highly educated than in the income of the less educated. 
The net result is an upv;ard bias to income differentials. Hov;- 
ever, this is the best that can be done. The use of median 
incomes, if they v;ere available, rather than mean incomes, v;ould 
also help to decrease the discrepancy, although it is hard to 
say hov7 much* 

A mortality table was used to express the probability that 
a person v/ho is alive at the age of I6 will still be alive at 
some future age, and this probability was used in the calcula- 
tion of future incomes. The mortality tables are by race and 
sex, "but not by educational attainment. Mortality rates for 
the educated may be lower than for the uneducated (because they 
have less physically demanding or dangerous jobs, and better 
medical care), but no suitable mortality tables were available 
to check this presumption. In any case, like the income figures, 
present cross-sectional data were used to represent longitudinal 
data* One may presume that mortality rates will decre=i3e in 
the future, but it is difficult to say hov; much. Because the 
probability of being alive for the next few years after age if 
is very high for any of the sex-race groups, and because comr 
tation of present values puts greater emphasis on benefits 3 
costs in the near future than in the distant future, the pc 
sible differences in mortality rates discussed above are p 
unimportant. 
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Some other studies have taken into account the income 
differentials among the various regions of the country. This 
b%udy did not do so for two reasons. First, there is no way_ 
of knowing the extent to which these differentials will persist 
into the future. The differentials have been decreasing, and 
wil] probably continue to do so. Secondly, the increased mo- 
bility of peoDle makes it a rather tenuous assumption that an 
individual will continue throughout his life ^ earn his living 
in the section of the country where he gets his education. This 
is true of the poorly educated, as the massive migration of 
rural southern Negroes to the northern cities in recent years 
shows. It is also true of the educated, who change jobs or are 
transferred to other sections of the country. 

Applying the income differentials discussed, the effect 
of education, sex and ethnicity on value of lifetime income, 
and ignoring and assuming rates of growth in ohe economy, life- 
time incomes at various discount rates and for different sexes 
and ethnic groups were derived. These incomes can be seen m 
Tables 2 and 3. 

One may note from Tables 2 and 3 that the total income of 
a white male high school dropout is roughly equivalent to that 
of a non-white male college graduate. This is a result of sev- 
eral things, the most important of which is differences in kinds 
of jobs obtained and rates of pay for •..•hites and non-whites. 
But there are other important effects. Unemployment of non- 
whites even the college educated, tends to be higher than 
uiemployment of wnites. Mortality rates for non-whites are 
higher than for v hites. And, of course, the person who completes 
college has roughly six years of very low earnings while attend- 
ing school, in comparison with the person who drops out of high 
school The effect of this last item is particularly apparent 
when one looks at the present value of lifetime income using 
the higher discount rates, since discounting has the effect of 
putting greater emphasis on the earlier years. In fact, given 
the effect of race on earnings, a white high school dropout, has 
an advantage over a non-white college graduate. 

The same tables demonstrate that the lifetime incomes of 
non-white females are consistently higher than incomes of white 
females. This does not mean that salary rates for non-white 
females 'are higher on the average than for white females, for 
they are not. It merely reflects the fact that non-white females 
are considerably more likely to be in the labor force, whereas 
•white females are more likely to withdraw from the laoor force 
and become housewives. The labor force participation rates for 
1967 were ^1-5. 6 percent for non-white females and 3°. 5 percent 
for white females. 

There is another possible source of upward bias in benefits 



ERIC 



41 

-46- 



Tabic 2 



Lifetime Incomes Assuming tiie Economy Grows 
3 Percent Per Year, by Race and Sex 



Present Value at 



Cate2:orv 



Wliite Males 

years higli school 
4 years high school 

vears collocie 
4 years college 

Wliite Females 
1-3 years high school 
^ years hit h school 
1-3 years college 
4 years college 



Total 
Income 



Percent 7. 5 Percent 10 Percent 



S 



634,618 
70S, 456 
802,708 
1,069, 167 

141,657 
190,984 
226, 530 
430, 125 



$175,835 
196,923 
208,847 
258, C62 

38,429 
47,938 
55, 774 
99,317 



S10S,981 
121. 725 
123,657 
146, 149 



23,805 
28,332 
32,642 
56,019 



$73,783 
81,983 
79, 533 
89,425 

16,215 
18,410 
20,984 
34,684 



Komvhile Mnlos 

1-3 years high school 39.3, 105 

4 yeai'S high school 453, 181 

1-3 years college 527,814 

4 years. college . 639,791 

Noi;v. hite Females 

1-3 years high school 164,352 

4 years high school 210,981 

1-3 years college 267,245 

4 years collogc 556,591 



113,854 
131, 519 
143, OSS 
161,060 

46, 241 
54, 672 
67, 673 
132. 123 



71,810 
82,679 
86, 146 
92, 593 

29,033 
32,680 
39.924 
75, 129 



49.267 
56.401 
56, 136 
57,488 

19,967 
21,387 
25,743 
46, 654 
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Table 3 

Value of Lifetime Income Ignoring Economic Growth 
by Race and Sex and Different Percents 



Category 



„ , , Present Value nt 

Total 

Income 5 Percent 7. 5 Percent 10 Percent 



White Males 

1-3 years high school $277, 96V $97,714 $66,809 

4 years high school 311,306- 109,018 74,094 

1-3 years college 340,308 109,443 70,912 

4 or more years college 435,671 127,711 78, 575 

White Females 

1-3 years high school 61,085 21,365 14,724 

4 years high school ■ 78,903 25,116 16,496 

1-3 years college 92,506 23,859 18,740 

4 or more years college 169, 363 49, 045 30, 641 

Komvhite MrJes 

1-3 years hip.h school 177,000 64,635 44,750 

4 years high school 204,574 74,322 51,127 

1-3 years college . 229,546 76,534 50,209 

4 or more years college 267,122 -81,241 50;700 

Komvhite Females 

1-3 years high school 72,520 26,132 18,169 

4 years high school 88,941 29,035 19,190 

1-3 years college 111,151 35,342 22,990 

4' or more years college 223,121 65,859 42, 990 



$48,913 
53, 838 
4S, 119 
51,708 

10,924 
11,696 
13, 116 
20,654 



37,466 
35, 096 
S3, 745 



12, 555 
13,6-10 
16,049 
27,693 
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that has to do with the possibility that Upward Bound stuaents 
will, on the average, enroll in colleges of lower quality than 
the Average student. Since there are no agreed-upon yardsticks 
for measuring college quality, there was no way of chec-ng this, 
but it is quite possible that it is so. Colleges of lower 
quality are more likely to have space available to accommodate 
additional students. Thus, average income differentials asso- 
ciated with differences in education may overstate the differen- 
tials which Upward Bound students may expect. Again, the possi- 
ble effect was noted, but no correction v/as made for it. 

Next, v/as a most important qualification. The assumption 
was made here that the marginal incomes of Upv/ard Bound students 
will be equal to the present average incomes of people with the 
same education. This will be true only so long as Upward Hound 
remains a marginal program. If this program were to enroll a 
substantial proiDortion of the disadvantaged and even graduate 
them from college, the increased supply of graduates would de- 
crease the price they could command, v/hile the decreased supply 
6f untrained labor would increase the price it could command. 
The assumptions about marginal costs can only be assumed to 
hold as long as the program continues to operate at or near the 
margin. 

Finally, there is an extremely important caveat having to 
do with the increased income caused by educat\on when viewed in 
a global sense. The assumption is m.ade that r.he colleges will 
be able to absorb all of the graduates of Upv;ard Bound or 
similar programs without displacing any other applicants ; in _ 
other words, that the colleges have excess capacity. It is dif- 
ficult to know the extent to v;hich this is so. The best colleges 
have tremendous compotition for the available places, and it 
seems probable that for every Upward Bound student accepted, some 
other student must be rejected. If this were true of all col- 
leges, it could be argued that there are no net social benefits 
as measured here arising from Upward Bound I One group of indi- 
viduals benefits at the exnense of another group. On the other 
hand, many of the smaller private colleges have plenty of excess 
capacity. Many, but not all, public institutions have open 
enrollment policies and are committed to providing places for 
all qualified applicants. There was insufficient time to analyze 
the colleges to which the population of Upvrard Bound students 
go, and the extent to which these colleges have excess capacity. 

It is important that the possible sources .of bias be pointed 
out in order that the policy-maker may understand the v/eaknesses 
of any given techniques. This is particularly true when the 
state-of-the-arts or the time constraints prevent one from fully 
correcting a possible variable. 

Having determined present values of lifetime incomes for 
the four sex-race groups for different levels of education, the 
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next problem was to determine the differential in lifetime in- 
come that is attributable to the Upv:ard Bo^ond program. To do 
this^ the percentages of Upv;ard Bound students and siblings 
achieving the various amounts of education v;ere noted ^ and a 
weighted mean salary for each v;as computed. The difference 
between these v;eighted mean salaries is the differential attri- 
butable to the Upv;ard Bound program. Ldfetime incomes were 
computed from age 16 (the earliest age v;hen a student is apt to 
drop out of high school for a full-time job^ and also the most 
likely age of entrance into Upv;ard Bound) up to age 65^ the 
usual age for retirement. Income continues after age 65^ but 
since it is usually unearned incom.e^ the amount of it v;hich is 
caused by education is dubious. In any case^ the impact in 
terms of present value of such minor income so far in the future 
is very small. 

Present values were computed to age I6 because that is the 
average age at v/hich the Upv/ard Bound experience begins. This 
means that all benefits and costs v;ere discounted to the begin-- 
ning point of the program^ v;hich is the decision point at v;hich 
an individual decides v;hether to enter it^ and the decision 
point at which the government decides whether or not to offer 
it. 

Starting the series of lifetime incomes at age I6 means 
that^ for those still in school^ incomes are quite small in the 
early years; by comparison^ for those who have dropped out of 
school^ incomes are much larger. If^ instead^ the income series 
had been started at age 22^ this would not have been so. In 
effect^ v;hat was done v/as to take the cost of foregone income 
while attending school into account in the lifetime income cal-- 
culations^ thus making it unnecessary to show it explicitly as 
a cost. This effect on ratio analysis of showing such foregone 
incomes as a decreased benefit instead of as a cost shows again 
the fol.ly of comparing cost/benefit ratios unless one knov;s 
exactly what are included in each. 



b. Upward Bound Stipend 

From the computer tape containing the records of the 7^236 
Upv/ard Bound students^ the average number of summer months and 
the average number of academic -year months spent in the Upward 
Bound program were calculated for each sex-^ace group. The cal- 
culation results are as follows: 
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Average Months in 
Upv:ard Bound Program 



Smamer Academic Year 



White males 
White females 
Non-v/hite males 
Non-white females 



3,22 13.06 

3.19 13.02 

3.^8 13,45 

3,48 13-40 



Charles Mertens^ of Applied Data Research^ Inc.^ stated 
that Upv/ard Bound students received in stipends 10.2 percent of 
the federal program dollar in 1966-1967^ and 12.3 percent in 
1967-1968, Federal program cost v;as approximately $405 per 
summer slot-month and 350 per academic year slot-month. A 
slot-month represents a program opening for a single student 
for a month. Thus^ a siommer slot-month cost of $405 means that 
it costs the government an avera.ge of $405 per month per stu- 
dent to operate a summer program. Assuming that stipends v/ere 
11.2 percent of these figures^ on the average^ v;hite males 
received 3-22 x $45. 36 4- 13*06 x 5-60^ or a total of $219. 
White females received an average of S2l8^ non-v/hite males re- 
ceived $233^ non-white females received $233. These figures 
were discounted 10 months to derive a present value for them. 



c. Scholarships and Grants 



The scholarships and grants that a student received v;hile 
in college are also a benefit, (Loans may not be^ for they must 
be repaid. However^ if the interest rate is less than the dis- 
count rate J they v/ould be a benefit.) It v;as possible to obtain 
from the tape the amount of the scholarships and grants received 
by an Upward Bound student^ if they v;ere recorded. The amount 
of the scholarships and grants that older siblings may have 
obtained is not known^ and that inforaat^on is necessary to ob- 
tain a differential attributable to the Upward Bound program. 
However^ it is probably true that scholarships and grants received 
by siblings v;ere minor compared to those received by Upv/ard Bound 
students^ for whom special efforts v/ere made. The assumption 
was made that older siblings received no scholarships or grants^ 
and it is recognized that this imparts an upward bias to related 
benefits . 

Analysis of the tape shows that^ for over half of the Up- 
ward Bound students who went on to college^ no scholarships or 
grant dollar amoionts v/ere recorded. A study of a small sample 
of Upv/ard Bound students by Charles Mertens convinced him that 
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virtually all Upward Bound students who v;ent to college received 
scholarships or grants. Accordingly^ the average amount re- 
ceived hy those v;ho v;ere recorded as receiving any amount v;as 
determined. The average amounts received v;ere as follows: 



Category 



Equal 
Opportunity Grants 



White males $46? 

White females 470 

Non-v;hite males 499 

Non-v/hite females 502 



Work-Study 


Other 




Grants 


Grants 


Total 


$189 


$ 83 


$739 


192 


86 


748 


170 


98 


767 


156 


135 


793 



These amounts v/ere assuraed to be the amounts received 
during the freshman year., and it was assumed that the student 
would continue to receive the same amounts during his succeeding 
years of college (a total of tv;o years if he dropped out^ four 
years if he completed college). T!he computation of present 
value v/as made by discounting the amounts received as freshman^ 
three years; those received as sophomores^ four years^ etc. 



d. Value of the Option of Further Education 

Weisbrod has pointed out the fact that v;hen a student drops 
out of high school he effectively forecloses the possibility of 
attending college. H If he graduates from high school^ even 
though he does not go on to college immediately^ he gains the 
option of doing so. Since^ if he exercises this option he can 
increase his income^ the option itself must have some monetary 
value. Weisbrod even gives a rather complicated formula for 
obtaining the value of such an option. Unfortunately^ the in- 
formation necessary to obtain a money value for this option is 
not available. In I965 Weisbrod stated that the value' of this 
option is probably not large. 1^ jn the present case^ it may be 
very small because the Upvrard Bound program has consisted pri-- 
marily of a strong effort to help students to further education. 



Burton A. Weisbrod "External Effects of Investment in 
Education/' in M. Blang (ed.). Economics of Education I , Penguin 
Books, 1968, pp. 156-ie2. 

12 

Burton A. Weisbrod, "Preventing High School Dropouts", 
in Robert Dorfman (ed.). Measuring Benefits of Governr^ent 
Investments, The Brookings Institution, VJashington, D.C., I965. 
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Thus^ we can probably assume that Upv;ard Bound students^ v;hen 
they stop their schooling^ are rather ^onlikely to pick it up 
again later. The value of the option was assuried to be zero 
in this study. 



e. Intangible Benefits 

By their nature^ intangible benefits cannot be expressed 
in dollars. Hence^ one is forced to ignore then in cost/bene- 
fit analyses^ even though one admits their existence. Some 
examples of intangible benefits v;ere given earlier. 



f. Costs to the Individual 



Tuition — Prom the point of viev/ of the individual^ it is 
\mimportant that the provision of schooling costs a good deal 
more than the tuition involved. He is concerned only v;ith his 
personal costs. Thus^ there is generally no cost to the in- 
dividual for a free public high school education. (Actually^ 
studies have shovm that there are some real costs associated 
with free secondary education^ but they are relatively minor^ 
and have been ignored in this study.) Tuition at college v/as 
calculated on the basis of average tuitions^ since it v/a^ not 
leasiuie in uie i^iiae invoxvea uo "ury bO rind out for each of 
the colleges that Upv:ard Bound students attended v;hat tuition 
was charged. In 1968-1969^ the average tuition charged by pub- 
lic institutions of higher education v;as $298-, and that of 
private institutions v:as $1^436.13 More than tv;o-thirds of the 
students in the United States attend public institutions^ and a 
v:eighted average tuition based on this differential attendance 
pattern is $602. (It is^ thus^ assumed that llpv;ard Bound stu- 
dents attend public and private institutions in the same propor- 
tions as do the general population of college students.) Assu- 
ming that a student starts college at age lo and completes it 
at age 22^ college costs for the freshman year have been dis- 
counted three years^ for the sophomore year^ four years^ etc. 
The same procedure v;as then used as v:as used in calculating 
lifetime income differentials to compute the differential tui- 
tion cost of college for Upvrard Bound students. 

Extra Living Costs vJhile Attending College -- It v;as as- 
sumed that v;hile^the student is in high school he v;as living at 
home^ and there were no extra living costs associated with 



^ Digest of Educational Statistics , 1968^ p. 95. 
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attending school. \Then the student attends college^ hov;ever^ 
there are extra costs involved. If the student lives at home 
while going to college^ the extra costs v;ill be for books^ sup- 
plies^ and transportation to and from school. If he leaves 
home and lives at the college his transportation costs v;ill be 
reduced^ but he v;ill have the cost of boai^d and room^ books., 
supplies^, and some transportation. On the other hand^ his 
family v;ill be able to reduce its expenses by the cost of the 
student's food. 

It was assumed thr.t a family v;ould feed a student v;ho 
lives at home for $1.50 a day. For nine months they save $400 
by having him av;ay at school. A vreighted average of room and 
board costs for I968-I969 vras $870^ so the difference v:as $470.1^ 
Books^ supplies^ and transportation might cost an additional 
$190, and would bring the total extra living cost to $66o. If 
the student lived at home^ his entire additional costs v;ould 
most likely average $190. If v;e assumed that half of the stu- 
dents lived at home while attending college^ the average addi- 
tional living costs would be the average of $660 and $190., or 
$425. These yearly costs were discounted in the same v;ay 
tuitions v;ere. 



Unemployment Payments and Welfare not Received There was 
no doubt thao unemploymeno cdrnpensauion is a benefit v;hen it is 
received^ and people who are receiving such benefits may often 
decide that they v/ould rather continue receiving benefits for 
the time being than take a job. Similarly^ then^ a student v;ho 
is considering undertaking the Upv;ard Bound program in order to 
increase his earning pov/er must take into accoxmt the fact that 
he v;ill be passing up the opportunity to receive unemployment 
benefits v;hich otherv/ise might accrue to him if he did not re- 
ceive the additional education. The same thing is true of v;el- 
fare pa;^Tnents v;hich might have been received by the individual 
or his family if he is unemployed^ but might not be if he gets 
more education. However^ it was unnecessary to calculate unem- 
ployment or welfare separately for the individual^ because the 
figures used for income differentials included receipts from 
unemployment insurance and from welfare. Thus^ when an indivi- 
dual goes from a high school dropout to a college graduate^ his 
increase in income is composed of (among other things) an in- 
crease in earnings resulting from more education^ and a decrease 
in unemployment and v;elfare payments. 



Computed from data in Digest of Educational Statistics. 
1968 . 



49 



This is true from the individual's point of viev;. Hov/ever^ 
from the point of viev; of society^ there is a net benefit if 
the v/elfare and unemplo:^Tient payments are reduced. There are 
resources to meet other needs — either for individuals^ because 
of reduced taxes^ or collectively^ through governmental action. 



Additional Taxes Paid Pechman has shown that in the mid- 
range of incomes^ total federal^ state ^ and local taxes take 
about 25 percent of the individual's income. -^5 



These are the factors v/hich v;ent into the costAenefit 
formula and the rationale for their inclusion. 

It v;as clear that for all groups at all discount rates ^ 
regardless of one's assumptions about the percentage of income 
differentials caused by education^ the Upv;ard Bound program is 
beneficial for the individual. In all cases the present value 
of benefits received v;as at least tv/ice the present value cosvs 
to the individual. As far as the individual v/as concerned^ he 
may have felt confident that enrollment in the Upward Bound 
program would be to his advantage. And this is aside from any 
unmeasured or intangible benefits. 

xlic 21i\yllxi^c> ;;oie iioi: <xs conclusive x'rom the government's 
point of view^ particularly in regard to black males. 



RESULTS OF THE ANALYSIS 

The results of the analysis demonstrate that the benefits 
outv;eighed the cost for all categories of students at each dis- 
count rate. Figure 1 on the following page presents pairs of 
bars which represent benefits and costs for each of the four 
sex-race categories. Each bar is divided into three parts. As 
incjicated in the example,, the distance from the baseline to the 
lov/est line on a bar indicates the benefits or costs if one as- 
sumes that only 60 percent of the differential in lifetime income 
is caused by education. This v:ould represent a conservative ap- 
proach to the analysis of benefits. The distance from the base- 
line to the top line of a bar represents benefits or costs^ if 
one assumes that 100 percent of lifetime income differentials 



^Joseph Pechman^ "The Rich^ the Poor^ and the Taxes Thev 
Pay," The Public Interest , Vol. 17, Fall I969, pp. 21-43. 
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FIGURE i 

BEUEFITS AND COSTS FROM THE IMDIVICUAL'S VIEV. POINT 
BY RACE, SEX AlIU DIFFEF.EHT PERCEHTS 



DISCOUNT RATE 10 PERCENT 



$5,000 



$0 



DISCOUNT RATE 7.5 PERCENT 



$5,000 



$0 



$15,000 



$10,000 



$5,000 



$0 



DISCOUNT RATE 5 PERCENT 



Benefits Costs Benefits Costs Benefits Costs Benefits Cost: 



WHITE 
MALES 



WHITE 
FEMALES 



NONWHITE 
MALES 



NONWHITE 
FEMALES 



Example: 



ill 



A Benefit or cost assuming 
60 Percent of Income dif- 
ferential is caused by ed- 
ucation. 

B Benefit or cost assuming 
80 Percent of inco.Tc dif- 
ferential is caused by ec- 
ucation. 

C Benefit or cost asGumlnci 
100 Percent of inccmo cif- 
ferential is caused by ed- 
ucation. 
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are caused by education. Vlhile v;e do not Icnov; hov/ much of the 
differential? are caused by education, it is clear that an 
assumption oi JO percent leaves nothing for other probable^ 
causal factors, and, therefore, is a limiting and unrealistic 
figure. The middle line in each bar represents benefits or 
costs if 80 percent of differences in lifetime incomes are 
caused by education. It represents a middle ground, and may 
be the most reasonable figure. 

In studying the figure, it is clear that, for all groups 
at all discount rates, regardless of one's assumptions about 
the percentage of income differentials caused by education, 
the Upward Bound program is beneficial for the individual. In 
all cases, the present value of benefits received is at least 
twice the present value of costs to the individual. As far as 
the individual is concerned, he may feel confident that enroll- 
ment in the Upv;ard Bound program v/ill be to his advantage. And 
this is aside' from unmeasured or intangible benefits of the kinds 
that v/ere discussed earlier. 

Similar tables and charts were used to show the cost/bene- 
fits for the government, which were not as favorable. 

E. FI^^^I^^GS ai^id REcot^.s^rPATions of these t.-io studies 

The second evaluation included the findings of the first 
evaluation, since the latter was a synthesis of all evaluations 
which had taken place previously; the findings and recommenda- 
tions of the two studies are presented together in the following 
summary form. The recommendatbns, it is always hoped, grow 
out of the findings . 

1, Findings on Student Characteristics and Program Ach ievement 
a. Recruitment 

1) Students recruited for Upv;ard Bound programs were 
generally representative of the academically underachieving 
and ecnomically disadvantaged youth in this country, especially 
those of minority groups. 

2) The Grade Point Average of students at the time of 
recruitment into Upward Bound ranged from 2.2? (C+) in 195? 

to 2.92 (B-) in I969, showing a small but significant increase, 
probably attricutable to a change in recruitment patterns. 

3) On the average, more than 10 percent of the students 
enrolled in Upward Bound in the years I966 to I969 have changed 
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their curriculum from nonacademic to college preparatory. 



h) From 1966 to I969 approximately 85 to 8? percent 
of the students recruited into Upward Bound met the poverty 
criteria guidelines established for admission into the program. 

5) Only a small fraction, approximately 4 percent, 
of the estimated 600,000 disadvantaged high school students 
v;ho could benefit, were enrolled. 

b. Retention in High School and Upv.'ard Bound 

1) Upv;ard Bound, in addition to serving as a channel 
to college for disadvantaged students, also acted as a deterrent 
to dropping out of high school. 

2) Retention in Upward Bound is a significant problem. 
Data indicate that at least one- third of the students enrolled 
in Upward Bound do not attend the final Bridge summer. 
Attrition at this critical point, often because the student 
needs to earn money for college, may well militate against 
success in college. 

c . Attitude Changes Purine; Upward Bound 

According to longitudinal studies undertaken by Hunt 
and Hardt with respect to students' attitudes on several impor- 
tant change measures, it was found there were significant 
score increases in such areas as motivation for college, 
interpersonal flexibility, self-esteem, internal control, 
and future orientation. 

d . Colleeie Enrollir.ent 

1) A large majority of Upward Bound students who 
graduate from high school and attend the Bridge summer, enroll 
in 'college . 

2) Data based on a large sample, 4,000 seniors, in 
Upward Bound during I969, show that 85 percent of these made 
application to college. Seventy percent of these seniors 
were subsequently enrolled in college. 

3) It has been found that larger numbers of Upward 
Bound students have been consistently enrolled in nonhost 
institutions rather than in host institutions during the years 
1966 to 1969. 
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4) It is a fact that the majority of Upward Bound 
students are not enrolled in Ivy League or 'prestige colleges. 

5) From 1967 to 1969 aTDTDroximately 20 percent of 

the average number of Upward Bound graduates enrolled in college 
reported that admissions requirements had been modified in 
some v;ay to permit them to enroll. 

6) The college in which an Upward Bound graduate 
enrolls is often determined by the financial aid package he _ 
is Offered or it may be the only college offering him financial 
assistance . 

7) Although some schools accepting Upward Bound 
students often do modify some admissions regulations, few offer 
realistic supportive academic services and counseling. 

e. College Retention 

1) According to available data from the years 1966 
to 1969, Upward Bound students in college have retention rates 
equal to those of the national college-going population. 

2) By comparison with their older siblings of the 
oer. "T^v^a^d Bouj^d students have significantly higher 

retention rates in high school and college. 

3) The basic reason Upward Bound students leave college 
is academic failure. 

f , Benefit-Cost Assessment 

The benefit-cost analvsis of the Upward Bound program 
indicated tha?rfor the individual, using a 10 percent discount 
^ate the average benefit-cost ratio for the Upward Bound parti- 
cipaAt was 3:10. For the government, at a 5 percent discount 
rate the average ratio was l:l6. Although the benefits of 
Se program to the individuals are extremely good, economically 
the prolram could be considered only marginally s^<:^ f ^ ^ 
the government. But it is unfair to examine benefits and costs 
in tlnns of one program without considering other alternatives. 
It is possible that Upward Bound, in terms of its goals wnen 
compared with other programs supposed to provide J^^f JJPf^f 
from poverty, may show relatively higher benei it-cost fatios 
than they do In addition, very important benefits not readily 
measured by k benef it-cost%tudy, in terms of dollars, may be 
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those such as the opportunity for the Upward Bound graduate 
and his children to live a life out of poverty, 

g. Institutional Change 

1) Some significant changes have been noted in many 
cf the host institutions, which may be attributed to their 
associatio' with the Upward Bound program, 

2) ..era has been no percentile change produced 
In the high schools by their assoc'ation with the Upward 
bound program. 

2, Findings o p ^- ogran Administration and Other Areas 

a, FjL r>r:^j,i Ai d to Upv/ard Bound College Students 

1) Through the Intervention and influence of the 
individual project director , currently most Upv/ard Bound 
students entering college receive financial aid packages 
which are adequate to meet their basic needs. 

2) Financial aid packages as offered may include 
loans which some Upward Bound students and their families are 
reluctant to undertake because of future encumbrances, 

b , National Level Administration 

1) Staff on the national level appears to be in- 
sufficient to process and handle administrative details and 
problems related to the functioning of the projects, 

:) Communications to local projects with respect 
to policy, procedures, and inforaa^ion about the Upward 
Bound project nationally are inadequate, 

3) Tuolic relations, primarily in the area of 
publicizing the Upward Bo^and program, goals, and accomplish- 
ments to the Congress, the academic community^ and the general 
public, have been insufficient, 

h) Services to local projects, such as assistance 
with budgeting and policy matters ctnd advice on problems and 
on rel. ticnships with host insti^.^itions and community organi- 
zations, e.ve often subject to delay in execution and resolution, 

c , Local Level Administration 

1) The Upward Bound Guidelin es have not been specific 
and clear with respect to participant selection. 
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2) Because it offers the simplest source^ there has 
been an over-reliance on the high schools to recruit partici- 
pants , 

3) The Guidelines suggest that a desirable staffing 
pattern for pro.jects v;ould include one- third secondary school 
and one-third university personnel but some projects report 
difficulty in recruiting university personnel because of 
inadequate budgets or late funding. 

4) The annual turnover rate of project directors has 
exceeded 30 percent, 

5) Many tutor-counselors viev;ed the definition of 
their job and the services they vjere expected to render as 
vague and ill-defined, 

6) Relations with host institutions^ high schools^ 
and boards of education have been v/eak and ineffectual. 

7) Parental involvement in ail aspects of Upv;ard 
Bound projects is negligible and in need of vast improvement, 

8) Involvement of Upward Bound programs with commu- 
nitv action agencies, service oreranizations • minority orga- 
nizations^ and local government v;as most inadequate^ as were 
relations with other poverty programs such as the Jobs Corps 
or VISTA, 

d , Curriculum 

1) The curriculum in Upv/ard Bound projects is as 
diversified as the many projects themselves, 

2) The counseling and guida.nce components of Upv;ard 
Bound need sharper delineation of the responsibilities to be 
assumed by each type of personnel, 

3) The follov;-up or academic-year component is in 
1 3ed of special study to improve its overall structure and 
the quantity and quality of its effort, 

e . Advisory Organizations 

1) The National Advisory Council and the National 
High School r^incipals Advi3ory Council, in the view of the 
National Directors , have rendered exemplary services to the 
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national administration of Upv/ard Bound and have been instru- 
mental in creating valuable changes over the years; hov/ever^ 
project directors were not informed of v;hat^ if anything^ such 
groups had done, 

2) Both the Public Advisory Council and the Academic 
Policy Group have generally functioned v;ith mixed effectiveness 

as groups* Project directors^ although not decrying their utility^ 
have tended to rely more on concerned and influential individual 
members of these groups the on the groups themselves, 

3) The nev;est ac ^sory group^ the Project Directors 
Steering Committee^ has been instramental in giving project 
directors representation in national program policy and decision- 
making, 

f , Funding 

The 1968 increase from 10 percent to 20 percent 
in the local contribution required did not^ as some feared^ 
lead to a reduction in either the number of nev/ proposals from 
colleges seeking to operate Upv;ard Bound programs or from pre- 
sent projects seeking refunding, Hov;ever^ this doubling of 
the local share of the budget has made it difficult for some 
colleges to sustain their commitment to Upv;ard Bound, 

g. Research 

1) Although a body of research has grown around 
Upward Bounds a number of program areas are in need of vital 
longitudinal research to guide program orientation and change, 

2) The present Upv/ard Bound data system was considered 
valuable in generating data on student and project characteris- 
tics for broad national program considerations. This v;as the 
task for v/hich it was designed. It does reveal shortcomings 
when attempts are made to utilize it for complex research 
involving longitudinal areas of change, 

3 , Recommendations 

a , Program Expansion 

Upward Bound should be increased to 75^000 enrollees 
in 1^000 projects v/ithin the next five years. This increase 
of about 700 projects should be staged so th^t about 1^0 new 
projects^ each v;ith approximately 75 students^ are added 
annually, 
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Recruitment 



1) Upv/ard Bound should remain a program for low- 
income students and should focus on the underachiever . 

2) Although project directors and other national 
staff have indicated that poverty income criteria are unrealis- 
tically low, no changes in these criteria could be m.ade v/ithout 
further study. 

3) The effort to recruit more black males than 
females into Upv/ard Bound should be increased. 

4) Upv/ard Bound should continue to be flexible in 
attempting to maintain racial balance in its programs. 

c . Financial Aid and Freshman Support 

1) Each Upv/ard Bound project should allocate some 
portion of its budget for personnel to counsel project gra-^ 
duates v/ho have entered post-secondary educational institutions. 

2) Upv/ard Bound host colleges should be prepared to 
provide supportive services for all Upv/ard Bound graduates in 
that college. 

d. National Program Operations 

1) The national staff of Upward Bound should be 
increased immediately. 

2) National staff members should receive on-the-job 
training before assuming full responsibility for the programs 
in an area. 

3) The annual national meeting of all project directors 
should continue to be held, preferably in the Fall. 

4) The national office should provide project directors 
with more information of all types. 

5) The role of the consultant site-visitor needs 
better definition and larger focus. 

6) To improve T:he overall quality of the consultant 
staff, it is felt that the selection of currently operating 
project directors for this role should be avoided because 
their evaluative judgement may be distinctly biased by their 
own program experience. 
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7) The relationship between the Upv/ard Bound and 
Talent Search programs which^, though different in focus, are 
complementary, should be one of increased cooperation, 

8) Upward Bound, along with the other Federal programs 
for disadvantaged students, should seak the active support of 
the community which should know more about the program, lobby 
for its support, and publicly endorse its aims and accomplish- 
ments . 

e , Local Program Operations 

1) Project directors should be simultaneously aware 
of the needs of the poverty community, the academic community, 
and the students. The ideal project director should be an 
educator whose racial and ethnic background and life experiences 
should reflect that of the majority of the students in his 
project , 

2) The national office should offer an annual or 
semi-annual training course for new project directors, who now 
represent one- third of the total number of directors each 
year , 

3) In order to have greater impact on communities 
and high schools, efforts shcv.ld be rr.ade, wherever possible, 
to increase the number of students recruited from a single 
high school, 

4) As Upward Bound students become college upper- 
classmen, they should be used in a wide number of academic and 
extracurricular roles on Upward Bound staffs, 

f , Curriculum 

1) Upward Bound should have a strong curriculum 
which must, at a minimum, teach the student to read and write 
with enough skill to met the requirerents of college. Reme- 
dial subject matter and study skill curricula should be 
innovative , 

2) Program 'lexibility is and should remain a central 
characteristic of Upward Bound. On the other hand, regional 
differences should not be used to justify interpretations of 
Upward Bound policy that may be at wide variance with the 
intent of the Guidelines . 

3) Continuing emphasis should be placed on the 
follow-up portion of Upward Bound programs to make them more 
effective. 
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g. Communit;/- Relations 



1) Upward Bound should continue its relationship 
with Community Action Agencies ana should continue to involve 
poor people in as many phases of the Upward Bound program 

as possible. 

2) The interrelationshiu of Upward Bound and its 
host institutions with the community from which the students 
come must continually be encouraged. 

h . Advisory Organizations 

1) The chairman of the Ucv.'ard Bound Project Directors 
Steering Corrnittee should, as part' of the Upward Bound grant 

to his institution, be provided with additional funds_ior 
travel communications, and secretarial assistance, m addition, 
he should have a full-time assistant director who can devote 
all his or her time to the local Upv;ard Bound program. 

2) All future meetings of the National Advisory 
council, the National High School Principals Advisory Council, 
and the ProTect Directors Steering Committee should be scheduled 
to allow all three com.mittees to meet jointly at least twice 
yearly to dooI their information and influence. 

i. Funding 

1) V/hen any additional Federal funds become available 
to Upward Bound, the first priority should be to return projects 
to the funding levels of I968 and, in addition to provide for 

a general increase in budgets of between 5 and « percent ot 
the Federal I96S level. 

2) These recommended additions and restorations of 
funds when available, should not be automatic but should be 
contincrent both upon the extremity of the need and, more 
importantly, the overall commitment of the host college and 
the Upward Bound program. 

3) Automatic refunding of programs should not be 
continued. Vigorous new programs should be funded in Place 
of programs which are qualitatively weak. Students should 
be relocated from any programs not refunded. 

F. CONCLUSIONS 

It is doubtful either of these evaluations had much 
impact on the decision-makers at the Federal level. There 
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v/as general agreement among the project staff and the personnel 
at the Federal level v/ho cooperated in carrying out these 
studies, particularly the second evaluation^ that Upv/ard 
Bound v/as an effective program. Hov/ever, it had stiff compe- 
tition from Talent Search, competing program in the Office 
of Education lo v/hich Upv/ard Bound v:as transferred during the 
second evaluation. Moreover, an economy drive on the part of 
the Federal establishment tended to curtail many programs 
funded to meet the needs of the disadvantaged. 
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